Jul 07 14:30:37.690390 ip-10-0-136-116 systemd[1]: Starting Kubernetes Kubelet... Jul 07 14:30:38.123680 ip-10-0-136-116 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:30:38.123680 ip-10-0-136-116 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 07 14:30:38.123680 ip-10-0-136-116 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:30:38.123680 ip-10-0-136-116 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 07 14:30:38.123680 ip-10-0-136-116 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 07 14:30:38.123680 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.123226 2564 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127839 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127861 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127865 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127869 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127872 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127875 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127878 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127880 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127882 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127885 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127888 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127890 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127893 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127896 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127898 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127901 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127903 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127906 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127908 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.129748 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127910 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127918 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127920 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127923 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127925 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127933 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127945 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127947 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127950 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127953 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127955 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127958 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127964 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127968 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127970 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127973 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127976 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127978 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127981 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127985 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.130566 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127988 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127992 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127994 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.127997 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128000 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128003 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128006 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128008 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128011 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128013 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128015 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128018 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128020 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128022 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128025 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128027 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128030 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128032 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128035 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128037 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.131971 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128040 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128043 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128045 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128048 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128050 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128053 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128055 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128058 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128060 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128063 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128065 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128068 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128072 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128075 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128078 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128081 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128083 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128087 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128091 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.132765 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128093 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128096 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128098 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128101 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128103 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128106 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128108 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128110 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128113 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128115 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128118 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128120 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128123 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128126 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128128 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128131 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128133 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128136 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128138 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128141 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.133573 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128143 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128828 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128834 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128837 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128840 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128843 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128846 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128848 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128851 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128860 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128863 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128865 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128868 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128870 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128873 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128875 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128877 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128880 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128882 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.135569 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128885 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128887 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128890 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128892 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128895 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128898 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128901 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128903 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128905 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128908 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128910 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128912 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128914 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128917 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128920 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128922 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128924 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128927 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128944 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.136381 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128947 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128950 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128953 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128956 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128959 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128961 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128963 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128967 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128969 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128971 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128974 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128976 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128979 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128981 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128984 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128986 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128988 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128993 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.128997 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.137821 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129000 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129003 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129006 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129010 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129014 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129016 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129034 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129038 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129041 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129045 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129049 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129054 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129057 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129060 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129063 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129067 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129070 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129072 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129075 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.138623 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129077 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129080 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129082 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129087 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129089 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129092 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129094 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129097 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129099 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129101 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129103 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129106 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129108 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129110 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129113 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129115 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129118 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129120 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129123 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129125 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.140260 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129128 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129130 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129132 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129135 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129510 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129514 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129516 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129519 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129522 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129526 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129529 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129532 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129535 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129538 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129540 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129546 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129548 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129551 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129553 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129555 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.141089 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129557 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129561 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129564 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129567 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129569 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129572 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129574 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129576 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129579 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129581 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129583 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129586 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129588 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129590 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129594 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129597 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129599 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129601 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129604 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.141905 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129606 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129608 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129614 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129616 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129619 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129621 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129623 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129626 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129632 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129634 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129637 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129639 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129642 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129644 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129646 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129649 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129651 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129653 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129656 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129658 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.142715 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129660 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129663 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129665 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129667 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129670 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129672 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129674 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129678 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129680 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129682 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129685 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129687 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129689 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129692 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129694 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129696 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129699 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129701 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129706 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129709 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.143553 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129713 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129716 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129718 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129721 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129723 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129726 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129728 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129731 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129733 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129736 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129738 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129741 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129744 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129746 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129749 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129751 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129754 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129757 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129760 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129764 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.144371 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129766 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129768 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129771 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.129773 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129835 2564 flags.go:64] FLAG: --address="0.0.0.0" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129847 2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129861 2564 flags.go:64] FLAG: --anonymous-auth="true" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129866 2564 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129870 2564 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129873 2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129877 2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129881 2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129885 2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129888 2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129891 2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129894 2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129897 2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129900 2564 flags.go:64] FLAG: --cgroup-root="" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129902 2564 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129905 2564 flags.go:64] FLAG: --client-ca-file="" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129908 2564 flags.go:64] FLAG: --cloud-provider="external" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129910 2564 flags.go:64] FLAG: --cluster-dns="[]" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129914 2564 flags.go:64] FLAG: --cluster-domain="" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129917 2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 07 14:30:38.145193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129920 2564 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129922 2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129926 2564 flags.go:64] FLAG: --container-log-max-files="5" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129944 2564 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129947 2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129950 2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129952 2564 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129957 2564 flags.go:64] FLAG: --contention-profiling="false" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129960 2564 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129963 2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129966 2564 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129968 2564 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129972 2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129975 2564 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129977 2564 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129980 2564 flags.go:64] FLAG: --enable-load-reader="false" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129983 2564 flags.go:64] FLAG: --enable-server="true" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129986 2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129991 2564 flags.go:64] FLAG: --event-burst="100" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129994 2564 flags.go:64] FLAG: --event-qps="50" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.129998 2564 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130001 2564 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130004 2564 flags.go:64] FLAG: --eviction-hard="" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130008 2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 07 14:30:38.146198 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130010 2564 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130013 2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130016 2564 flags.go:64] FLAG: --eviction-soft="" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130018 2564 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130021 2564 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130024 2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130027 2564 flags.go:64] FLAG: --experimental-mounter-path="" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130029 2564 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130032 2564 flags.go:64] FLAG: --fail-swap-on="true" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130035 2564 flags.go:64] FLAG: --feature-gates="" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130038 2564 flags.go:64] FLAG: --file-check-frequency="20s" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130041 2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130044 2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130047 2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130050 2564 flags.go:64] FLAG: --healthz-port="10248" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130054 2564 flags.go:64] FLAG: --help="false" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130057 2564 flags.go:64] FLAG: --hostname-override="ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130060 2564 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130062 2564 flags.go:64] FLAG: --http-check-frequency="20s" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130065 2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130068 2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130071 2564 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130074 2564 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 07 14:30:38.147228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130076 2564 flags.go:64] FLAG: --image-service-endpoint="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130079 2564 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130082 2564 flags.go:64] FLAG: --kube-api-burst="100" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130085 2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130088 2564 flags.go:64] FLAG: --kube-api-qps="50" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130092 2564 flags.go:64] FLAG: --kube-reserved="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130095 2564 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130097 2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130100 2564 flags.go:64] FLAG: --kubelet-cgroups="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130103 2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130106 2564 flags.go:64] FLAG: --lock-file="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130108 2564 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130110 2564 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130113 2564 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130118 2564 flags.go:64] FLAG: --log-json-split-stream="false" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130121 2564 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130124 2564 flags.go:64] FLAG: --log-text-split-stream="false" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130126 2564 flags.go:64] FLAG: --logging-format="text" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130129 2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130132 2564 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130134 2564 flags.go:64] FLAG: --manifest-url="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130136 2564 flags.go:64] FLAG: --manifest-url-header="" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130141 2564 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130143 2564 flags.go:64] FLAG: --max-open-files="1000000" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130148 2564 flags.go:64] FLAG: --max-pods="110" Jul 07 14:30:38.148246 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130151 2564 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130154 2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130156 2564 flags.go:64] FLAG: --memory-manager-policy="None" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130159 2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130161 2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130164 2564 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130167 2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130174 2564 flags.go:64] FLAG: --node-status-max-images="50" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130177 2564 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130179 2564 flags.go:64] FLAG: --oom-score-adj="-999" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130182 2564 flags.go:64] FLAG: --pod-cidr="" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130185 2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130191 2564 flags.go:64] FLAG: --pod-manifest-path="" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130195 2564 flags.go:64] FLAG: --pod-max-pids="-1" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130198 2564 flags.go:64] FLAG: --pods-per-core="0" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130201 2564 flags.go:64] FLAG: --port="10250" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130204 2564 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130207 2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d1de839bef1984c4" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130210 2564 flags.go:64] FLAG: --qos-reserved="" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130212 2564 flags.go:64] FLAG: --read-only-port="10255" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130215 2564 flags.go:64] FLAG: --register-node="true" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130217 2564 flags.go:64] FLAG: --register-with-taints="" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130221 2564 flags.go:64] FLAG: --registry-burst="10" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130223 2564 flags.go:64] FLAG: --registry-qps="5" Jul 07 14:30:38.149278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130226 2564 flags.go:64] FLAG: --reserved-cpus="" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130228 2564 flags.go:64] FLAG: --reserved-memory="" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130231 2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130234 2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130237 2564 flags.go:64] FLAG: --rotate-certificates="false" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130239 2564 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130242 2564 flags.go:64] FLAG: --runonce="false" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130246 2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130249 2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130251 2564 flags.go:64] FLAG: --seccomp-default="false" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130254 2564 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130257 2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130259 2564 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130262 2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130265 2564 flags.go:64] FLAG: --storage-driver-password="root" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130267 2564 flags.go:64] FLAG: --storage-driver-secure="false" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130270 2564 flags.go:64] FLAG: --storage-driver-table="stats" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130272 2564 flags.go:64] FLAG: --storage-driver-user="root" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130275 2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130278 2564 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130281 2564 flags.go:64] FLAG: --system-cgroups="" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130284 2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130289 2564 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130291 2564 flags.go:64] FLAG: --tls-cert-file="" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130294 2564 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 07 14:30:38.150286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130297 2564 flags.go:64] FLAG: --tls-min-version="" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130300 2564 flags.go:64] FLAG: --tls-private-key-file="" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130303 2564 flags.go:64] FLAG: --topology-manager-policy="none" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130305 2564 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130308 2564 flags.go:64] FLAG: --topology-manager-scope="container" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130310 2564 flags.go:64] FLAG: --v="2" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130314 2564 flags.go:64] FLAG: --version="false" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130318 2564 flags.go:64] FLAG: --vmodule="" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130321 2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.130324 2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130432 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130436 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130439 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130442 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130446 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130448 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130450 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130453 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130455 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130458 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130461 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130465 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.206579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130467 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.197554 ip-10-0-136-116 systemd[1]: Started Kubernetes Kubelet. Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130470 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130472 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130475 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130477 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130479 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130484 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130486 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130489 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130491 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130493 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130496 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130498 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130501 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130503 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130505 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130507 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130510 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130512 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130514 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.207850 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130517 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130519 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130522 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130524 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130527 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130531 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130534 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130537 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130540 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130542 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130545 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130547 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130550 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130552 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130555 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130558 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130561 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130563 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130567 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.209894 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130570 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130573 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130576 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130578 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130581 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130584 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130586 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130589 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130591 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130593 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130596 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130598 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130600 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130602 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130605 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130608 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130610 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130613 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130616 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130618 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.210893 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130620 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130623 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130625 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130627 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130629 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130632 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130634 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130637 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130639 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130641 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130643 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130646 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130649 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130651 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130654 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130656 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130658 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130661 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130663 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.212514 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130665 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130667 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130670 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130672 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130674 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130677 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130679 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130682 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.130685 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.131395 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.137859 2564 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.137876 2564 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.137894 2564 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.137899 2564 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.137982 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.213528 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.137987 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.137990 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.137993 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.137996 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.137999 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138002 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138004 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138007 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138009 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138012 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138014 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138018 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138020 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138023 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138025 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138029 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138031 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138034 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138037 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138040 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.214144 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138042 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138044 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138047 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138049 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138052 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138055 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138057 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138059 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138062 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138064 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138066 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138069 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138071 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138073 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138077 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138080 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138083 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138085 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138088 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.214980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138090 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138093 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138095 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138097 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138100 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138102 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138105 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138107 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138109 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138112 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138115 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138117 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138120 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138123 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138127 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138130 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138133 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138135 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138138 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.215754 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138140 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138142 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138145 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138147 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138150 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138152 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138154 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138156 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138159 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138161 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138163 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138166 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138168 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138170 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138173 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138175 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138178 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138180 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138182 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138186 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.217164 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138189 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138191 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138193 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138196 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138198 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138201 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138203 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138205 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138208 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138210 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138212 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138216 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138219 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138222 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138225 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138228 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138230 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138233 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138235 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.218172 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138238 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.138242 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138349 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138354 2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138357 2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138360 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138362 2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138365 2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138368 2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138371 2564 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138374 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138376 2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138378 2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138381 2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138383 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 07 14:30:38.219188 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138386 2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138388 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138390 2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138392 2564 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138395 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138397 2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138399 2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138402 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138404 2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138406 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138408 2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138411 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138413 2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138416 2564 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138418 2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138421 2564 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138424 2564 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138426 2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138429 2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 07 14:30:38.220168 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138431 2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138433 2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138436 2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138438 2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138441 2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138444 2564 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138447 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138449 2564 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138452 2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138454 2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138456 2564 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138459 2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138462 2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138464 2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138466 2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138469 2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138471 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138473 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138476 2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 07 14:30:38.221547 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138478 2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138481 2564 feature_gate.go:328] unrecognized feature gate: Example2 Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138483 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138485 2564 feature_gate.go:328] unrecognized feature gate: Example Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138488 2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138490 2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138492 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138497 2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138499 2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138502 2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138505 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138507 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138510 2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138513 2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138516 2564 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138518 2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138520 2564 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138523 2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138525 2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138527 2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 07 14:30:38.222354 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138531 2564 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138534 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138536 2564 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138540 2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138542 2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138545 2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138547 2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138550 2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138553 2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138555 2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138557 2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138559 2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138562 2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138564 2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138566 2564 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138568 2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138571 2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138573 2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138575 2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138579 2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 07 14:30:38.223544 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138581 2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138584 2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138586 2564 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138588 2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138591 2564 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138593 2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138595 2564 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:38.138598 2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.138602 2564 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.138714 2564 server.go:962] "Client rotation is on, will bootstrap in background" Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.140757 2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.142233 2564 server.go:1019] "Starting client certificate rotation" Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.144690 2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:30:38.224356 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.148252 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.148283 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.148291 2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.165741 2564 log.go:25] "Validated CRI v1 runtime API" Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.168345 2564 log.go:25] "Validated CRI v1 image API" Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.169095 2564 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.171479 2564 fs.go:135] Filesystem UUIDs: map[31c9b1ba-a6f6-4e28-8020-cff6e7985112:/dev/nvme0n1p4 4eba830a-798c-4477-a1b7-615f29f08aa3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 07 14:30:38.225565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.171493 2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.174914 2564 manager.go:216] Machine: {Timestamp:2026-07-07 14:30:38.174465731 +0000 UTC m=+0.357212591 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099404 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b8b2159c84e643d7e6bbbff6ff489 SystemUUID:ec2b8b21-59c8-4e64-3d7e-6bbbff6ff489 BootID:053ae89f-6495-4777-ad85-819feeccbb25 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ad:7e:4f:4d:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ad:7e:4f:4d:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:74:b2:73:28:35 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.175026 2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.175107 2564 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.177748 2564 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.177775 2564 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-116.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.178688 2564 topology_manager.go:138] "Creating topology manager with none policy" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.178697 2564 container_manager_linux.go:309] "Creating device plugin manager" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.178708 2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.179321 2564 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.180490 2564 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.183713 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.183844 2564 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184505 2564 kubelet.go:486] "Attempting to sync node with API server" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184520 2564 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184532 2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184542 2564 kubelet.go:398] "Adding apiserver pod source" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184550 2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 07 14:30:38.226757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184859 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.184873 2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.187256 2564 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.189027 2564 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.189053 2564 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190203 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190215 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190229 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190234 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190242 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190248 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190254 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190259 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190266 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190271 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190285 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.190290 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.191766 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.191775 2564 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.196908 2564 server.go:1268] "Started kubelet" Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.198408 2564 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.198479 2564 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.198538 2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 07 14:30:38.227573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.199526 2564 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.237381 2564 server.go:310] "Adding debug handlers to kubelet server" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.238205 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.238676 2564 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.247007 2564 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-116.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.248719 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.248736 2564 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-116.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249025 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pcctf" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249044 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pcctf" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249137 2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249138 2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.249370 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249742 2564 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249749 2564 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249754 2564 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249848 2564 reconstruct.go:97] "Volume reconstruction finished" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.249858 2564 reconciler.go:29] "Reconciler: start to sync state" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.247199 2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-116.ec2.internal.18c0085ab9da49a9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-116.ec2.internal,UID:ip-10-0-136-116.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-116.ec2.internal,},FirstTimestamp:2026-07-07 14:30:38.196885929 +0000 UTC m=+0.379632787,LastTimestamp:2026-07-07 14:30:38.196885929 +0000 UTC m=+0.379632787,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-116.ec2.internal,}" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251279 2564 factory.go:55] Registering systemd factory Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251295 2564 factory.go:223] Registration of the systemd container factory successfully Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251504 2564 factory.go:153] Registering CRI-O factory Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251521 2564 factory.go:223] Registration of the crio container factory successfully Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251560 2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251577 2564 factory.go:103] Registering Raw factory Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251587 2564 manager.go:1196] Started watching for new ooms in manager Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.251951 2564 manager.go:349] Starting recovery of all containers Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.255627 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.260905 2564 manager.go:354] Recovery completed Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.262358 2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-136-116.ec2.internal\" not found" node="ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.266459 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.268248 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.268269 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.268279 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.268858 2564 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.268866 2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.268884 2564 state_mem.go:36] "Initialized new in-memory state store" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.270090 2564 policy_none.go:49] "None policy: Start" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.270100 2564 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.270109 2564 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 07 14:30:38.297841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.271172 2564 policy_none.go:47] "Start" Jul 07 14:30:38.299248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.271877 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.299248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.272969 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.299248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.272989 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.299248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.272997 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314233 2564 manager.go:337] "Starting Device Plugin manager" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.314266 2564 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314279 2564 server.go:87] "Starting device plugin registration server" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314551 2564 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314563 2564 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314749 2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314829 2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.314838 2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.315427 2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 07 14:30:38.403389 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.315487 2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.415607 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.424567 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.424642 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.424658 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.424715 2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.432518 2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.432542 2564 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-116.ec2.internal\": node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.445681 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.494143 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.495563 2564 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.495598 2564 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.495637 2564 kubelet.go:2448] "Starting kubelet main sync loop" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.495665 2564 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 07 14:30:38.520181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.497735 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.546301 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.595867 2564 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal"] Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.595951 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.596857 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.596907 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.596924 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598101 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598227 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598251 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598779 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598800 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598810 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598820 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598839 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.598848 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.599908 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.599952 2564 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.600633 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientMemory" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.600661 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasNoDiskPressure" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.600674 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeHasSufficientPID" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.640751 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-116.ec2.internal\" not found" node="ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.645017 2564 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-116.ec2.internal\" not found" node="ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.649636 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.646972 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.652764 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.651175 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ab78a6284d85a2a04f046f66c180936-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal\" (UID: \"0ab78a6284d85a2a04f046f66c180936\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.652764 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.651196 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab78a6284d85a2a04f046f66c180936-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal\" (UID: \"0ab78a6284d85a2a04f046f66c180936\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.652764 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.651212 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12c88708317f1b5944d421053e667ab6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-116.ec2.internal\" (UID: \"12c88708317f1b5944d421053e667ab6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.747292 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.751495 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12c88708317f1b5944d421053e667ab6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-116.ec2.internal\" (UID: \"12c88708317f1b5944d421053e667ab6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.751534 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ab78a6284d85a2a04f046f66c180936-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal\" (UID: \"0ab78a6284d85a2a04f046f66c180936\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.751555 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab78a6284d85a2a04f046f66c180936-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal\" (UID: \"0ab78a6284d85a2a04f046f66c180936\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.751580 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ab78a6284d85a2a04f046f66c180936-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal\" (UID: \"0ab78a6284d85a2a04f046f66c180936\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.751613 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/12c88708317f1b5944d421053e667ab6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-116.ec2.internal\" (UID: \"12c88708317f1b5944d421053e667ab6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.796326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.751629 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ab78a6284d85a2a04f046f66c180936-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal\" (UID: \"0ab78a6284d85a2a04f046f66c180936\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.873593 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.847791 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.944223 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.944179 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:38.954913 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:38.954889 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:38.959353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:38.959333 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" Jul 07 14:30:39.055872 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:39.055793 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:39.149012 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.148969 2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 07 14:30:39.149453 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.149161 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:30:39.149453 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.149159 2564 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 07 14:30:39.156182 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:39.156144 2564 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-116.ec2.internal\" not found" Jul 07 14:30:39.201586 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.201557 2564 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:39.249355 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.249321 2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 07 14:30:39.249721 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.249705 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" Jul 07 14:30:39.251471 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.251448 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 14:25:38 +0000 UTC" deadline="2028-02-23 04:18:06.335851247 +0000 UTC" Jul 07 14:30:39.251529 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.251473 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14293h47m27.084382244s" Jul 07 14:30:39.262044 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.262022 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:30:39.263894 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.263879 2564 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" Jul 07 14:30:39.264917 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.264902 2564 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 07 14:30:39.269577 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.269556 2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 07 14:30:39.287733 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.287708 2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wz42b" Jul 07 14:30:39.296641 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.296619 2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wz42b" Jul 07 14:30:39.560046 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:39.560008 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12c88708317f1b5944d421053e667ab6.slice/crio-a0ee08dd02eba2597b62b1a1fe264a0a108c7d48ab2e4ffab04d67e3c1e7d250 WatchSource:0}: Error finding container a0ee08dd02eba2597b62b1a1fe264a0a108c7d48ab2e4ffab04d67e3c1e7d250: Status 404 returned error can't find the container with id a0ee08dd02eba2597b62b1a1fe264a0a108c7d48ab2e4ffab04d67e3c1e7d250 Jul 07 14:30:39.564892 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:39.564854 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab78a6284d85a2a04f046f66c180936.slice/crio-30cd191dcca195ca90186abfc3cc497d346b5f2e8018d0df13a516d9d7ef8377 WatchSource:0}: Error finding container 30cd191dcca195ca90186abfc3cc497d346b5f2e8018d0df13a516d9d7ef8377: Status 404 returned error can't find the container with id 30cd191dcca195ca90186abfc3cc497d346b5f2e8018d0df13a516d9d7ef8377 Jul 07 14:30:39.567195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.567183 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:30:39.744204 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:39.744111 2564 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:40.185658 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.185550 2564 apiserver.go:52] "Watching apiserver" Jul 07 14:30:40.193876 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.193840 2564 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 07 14:30:40.196305 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.196275 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-frgw7","kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6","openshift-cluster-node-tuning-operator/tuned-wl8fw","openshift-image-registry/node-ca-p497s","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal","openshift-multus/multus-additional-cni-plugins-gsvjt","openshift-multus/multus-zljtj","kube-system/global-pull-secret-syncer-kq895","openshift-dns/node-resolver-pj7xj","openshift-multus/network-metrics-daemon-gqsjh","openshift-network-diagnostics/network-check-target-45vm5","openshift-network-operator/iptables-alerter-r52bh","openshift-ovn-kubernetes/ovnkube-node-7w99l"] Jul 07 14:30:40.197953 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.197918 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.201146 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.200807 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 07 14:30:40.201337 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.201148 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.201415 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.201347 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 07 14:30:40.201415 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.201403 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wbbgs\"" Jul 07 14:30:40.201552 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.201532 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 07 14:30:40.201609 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.201541 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.202087 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.202057 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.203058 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.203042 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.203996 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.203651 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.203996 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.203770 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 07 14:30:40.203996 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.203860 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.203996 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.203903 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-b9mkk\"" Jul 07 14:30:40.204676 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.204500 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.204768 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.204752 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 07 14:30:40.205124 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.205105 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.205201 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.205177 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.205609 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.205444 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-z5vqt\"" Jul 07 14:30:40.205900 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.205865 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.207871 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.207052 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209005 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.209070 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209367 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209500 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209571 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.209697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209662 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 07 14:30:40.210104 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209758 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.210104 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209854 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 07 14:30:40.210104 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.209884 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-v2ndp\"" Jul 07 14:30:40.210104 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210002 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4qcpb\"" Jul 07 14:30:40.210292 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210139 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 07 14:30:40.210292 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210183 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-p5k77\"" Jul 07 14:30:40.210415 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210394 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.210502 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210459 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.210560 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210516 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.210730 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.210715 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 07 14:30:40.211786 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.211769 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.212979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.212959 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 07 14:30:40.213074 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.213021 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-xmw2r\"" Jul 07 14:30:40.213226 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.213211 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 07 14:30:40.213883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.213863 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 07 14:30:40.213883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.213876 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gpsxk\"" Jul 07 14:30:40.214658 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.214302 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.216338 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.216148 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.216338 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.216215 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 07 14:30:40.216338 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.216222 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:40.216338 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.216316 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5mwdf\"" Jul 07 14:30:40.216598 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.216464 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 07 14:30:40.217646 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.217621 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:40.217742 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.217688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:40.251040 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.251017 2564 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9b84275-38aa-4e56-9200-37a23b9d41f9-iptables-alerter-script\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260635 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-socket-dir-parent\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-k8s-cni-cncf-io\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-netns\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260710 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k48lt\" (UniqueName: \"kubernetes.io/projected/ca26787a-aee8-493b-a8da-3e16abe3062f-kube-api-access-k48lt\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260733 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-var-lib-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-node-log\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260775 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/853b0783-7a26-4123-b273-4626446e2285-agent-certs\") pod \"konnectivity-agent-frgw7\" (UID: \"853b0783-7a26-4123-b273-4626446e2285\") " pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260799 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/853b0783-7a26-4123-b273-4626446e2285-konnectivity-ca\") pod \"konnectivity-agent-frgw7\" (UID: \"853b0783-7a26-4123-b273-4626446e2285\") " pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260821 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0937ba0e-fe91-485f-859b-9b2e83aa6037-tmp-dir\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260845 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-kubelet-config\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260870 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11c19c14-8520-4178-b78d-91853fbb6218-multus-daemon-config\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260891 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260912 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-socket-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260950 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-os-release\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.263592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260972 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9nzhp\" (UniqueName: \"kubernetes.io/projected/bba5a29c-b602-441c-a56e-c9f99d86d642-kube-api-access-9nzhp\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.260993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-etc-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261016 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-os-release\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sttz4\" (UniqueName: \"kubernetes.io/projected/11c19c14-8520-4178-b78d-91853fbb6218-kube-api-access-sttz4\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261068 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wklc5\" (UniqueName: \"kubernetes.io/projected/abea0031-a712-49b4-8bd5-fff810a656de-kube-api-access-wklc5\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0937ba0e-fe91-485f-859b-9b2e83aa6037-hosts-file\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-tuned\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-cni-multus\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-conf-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysctl-d\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261207 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-ovnkube-config\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261230 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-multus-certs\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261253 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-749rv\" (UniqueName: \"kubernetes.io/projected/581936ef-d2cd-49ad-a3c1-53f962e87c81-kube-api-access-749rv\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261276 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-kubelet\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-systemd\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261320 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.264542 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261345 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkcw4\" (UniqueName: \"kubernetes.io/projected/d9b84275-38aa-4e56-9200-37a23b9d41f9-kube-api-access-gkcw4\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261365 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-dbus\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261388 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-modprobe-d\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261412 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysctl-conf\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261437 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca26787a-aee8-493b-a8da-3e16abe3062f-tmp\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261460 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-cni-bin\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261482 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-hostroot\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-etc-kubernetes\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-slash\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261546 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/acc2e68a-d850-4802-b0e0-a67a809a0d08-serviceca\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-cni-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261589 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11c19c14-8520-4178-b78d-91853fbb6218-cni-binary-copy\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261615 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-cnibin\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-etc-selinux\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261694 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-systemd-units\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261716 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.265411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mf2j\" (UniqueName: \"kubernetes.io/projected/acc2e68a-d850-4802-b0e0-a67a809a0d08-kube-api-access-7mf2j\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261770 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-cni-bin\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261796 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-system-cni-dir\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261824 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261849 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-kubernetes\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261872 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-sys\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261897 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-lib-modules\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-ovnkube-script-lib\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261964 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n6j4\" (UniqueName: \"kubernetes.io/projected/207739af-5203-470c-a881-a7dd9ae61e8a-kube-api-access-7n6j4\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.261989 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262011 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-cni-binary-copy\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262037 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262060 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-var-lib-kubelet\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262084 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-kubelet\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262137 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-registration-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.266206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-systemd\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262182 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-cni-netd\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262205 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262232 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262262 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-device-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262290 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l448c\" (UniqueName: \"kubernetes.io/projected/0937ba0e-fe91-485f-859b-9b2e83aa6037-kube-api-access-l448c\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262328 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-system-cni-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262350 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-cnibin\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-sys-fs\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262396 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysconfig\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-host\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262442 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-run-netns\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262464 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-ovn\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262487 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/207739af-5203-470c-a881-a7dd9ae61e8a-ovn-node-metrics-cert\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262509 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9b84275-38aa-4e56-9200-37a23b9d41f9-host-slash\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262530 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acc2e68a-d850-4802-b0e0-a67a809a0d08-host\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-run\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.267082 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262572 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-log-socket\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.268014 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.262597 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-env-overrides\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.299342 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.299219 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:25:39 +0000 UTC" deadline="2028-02-11 18:52:22.708586123 +0000 UTC" Jul 07 14:30:40.299342 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.299283 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14020h21m42.409307078s" Jul 07 14:30:40.363239 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363199 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-modprobe-d\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.363438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363255 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysctl-conf\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.363438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363281 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca26787a-aee8-493b-a8da-3e16abe3062f-tmp\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.363438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-cni-bin\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.363438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363387 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-hostroot\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.363438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363430 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-etc-kubernetes\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363450 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-modprobe-d\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363471 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysctl-conf\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-slash\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363503 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-hostroot\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363510 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-slash\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363490 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-cni-bin\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/acc2e68a-d850-4802-b0e0-a67a809a0d08-serviceca\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363536 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-etc-kubernetes\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363561 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-cni-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11c19c14-8520-4178-b78d-91853fbb6218-cni-binary-copy\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363613 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-cnibin\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363639 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363663 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-etc-selinux\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363684 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-systemd-units\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.363690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363692 2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-cnibin\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363726 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-cni-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363736 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mf2j\" (UniqueName: \"kubernetes.io/projected/acc2e68a-d850-4802-b0e0-a67a809a0d08-kube-api-access-7mf2j\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363771 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-systemd-units\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363787 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-cni-bin\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363808 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-run-ovn-kubernetes\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-system-cni-dir\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363822 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-etc-selinux\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363844 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-system-cni-dir\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363846 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363886 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-kubernetes\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363891 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-cni-bin\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363908 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-sys\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363932 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-lib-modules\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.363976 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-ovnkube-script-lib\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.364419 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364001 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n6j4\" (UniqueName: \"kubernetes.io/projected/207739af-5203-470c-a881-a7dd9ae61e8a-kube-api-access-7n6j4\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364027 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-tuning-conf-dir\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364050 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-cni-binary-copy\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364095 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-var-lib-kubelet\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364147 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364171 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-kubelet\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364196 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-registration-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/11c19c14-8520-4178-b78d-91853fbb6218-cni-binary-copy\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-lib-modules\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364221 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-systemd\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364707 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-systemd\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364707 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-cni-netd\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364741 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364753 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-cni-netd\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364766 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.365254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/acc2e68a-d850-4802-b0e0-a67a809a0d08-serviceca\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364793 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-device-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364815 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l448c\" (UniqueName: \"kubernetes.io/projected/0937ba0e-fe91-485f-859b-9b2e83aa6037-kube-api-access-l448c\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364861 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-kubernetes\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364964 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-registration-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.364987 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365012 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-var-lib-kubelet\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.365076 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.365079 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-device-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-system-cni-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-kubelet\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365126 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-cnibin\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.365180 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:40.8651429 +0000 UTC m=+3.047889748 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365200 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-sys-fs\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysconfig\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-sys\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365265 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-system-cni-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.366072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365300 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365317 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-cnibin\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365343 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-host\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-run-netns\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-sys-fs\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.365402 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:40.865387721 +0000 UTC m=+3.048134576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-ovn\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365439 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-host\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365437 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-run-netns\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365445 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/207739af-5203-470c-a881-a7dd9ae61e8a-ovn-node-metrics-cert\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365462 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-ovnkube-script-lib\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365478 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9b84275-38aa-4e56-9200-37a23b9d41f9-host-slash\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365483 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-ovn\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365502 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acc2e68a-d850-4802-b0e0-a67a809a0d08-host\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365526 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d9b84275-38aa-4e56-9200-37a23b9d41f9-host-slash\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-run\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-log-socket\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.366914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365588 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysconfig\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/acc2e68a-d850-4802-b0e0-a67a809a0d08-host\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-env-overrides\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365643 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-run\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365672 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9b84275-38aa-4e56-9200-37a23b9d41f9-iptables-alerter-script\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365694 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-socket-dir-parent\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365733 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-k8s-cni-cncf-io\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365754 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-socket-dir-parent\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365758 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-netns\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k48lt\" (UniqueName: \"kubernetes.io/projected/ca26787a-aee8-493b-a8da-3e16abe3062f-kube-api-access-k48lt\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365877 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-log-socket\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.365933 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-env-overrides\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366000 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-netns\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366036 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-k8s-cni-cncf-io\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-cni-binary-copy\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366071 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-var-lib-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366098 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-node-log\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366141 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-node-log\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.367798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366162 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-var-lib-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366175 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/853b0783-7a26-4123-b273-4626446e2285-agent-certs\") pod \"konnectivity-agent-frgw7\" (UID: \"853b0783-7a26-4123-b273-4626446e2285\") " pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366201 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/853b0783-7a26-4123-b273-4626446e2285-konnectivity-ca\") pod \"konnectivity-agent-frgw7\" (UID: \"853b0783-7a26-4123-b273-4626446e2285\") " pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366279 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0937ba0e-fe91-485f-859b-9b2e83aa6037-tmp-dir\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366307 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-kubelet-config\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366333 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11c19c14-8520-4178-b78d-91853fbb6218-multus-daemon-config\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366357 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bba5a29c-b602-441c-a56e-c9f99d86d642-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366413 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-kubelet-config\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d9b84275-38aa-4e56-9200-37a23b9d41f9-iptables-alerter-script\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366666 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0937ba0e-fe91-485f-859b-9b2e83aa6037-tmp-dir\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366697 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-socket-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366724 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-kubelet-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366772 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-os-release\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366801 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9nzhp\" (UniqueName: \"kubernetes.io/projected/bba5a29c-b602-441c-a56e-c9f99d86d642-kube-api-access-9nzhp\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366866 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/11c19c14-8520-4178-b78d-91853fbb6218-multus-daemon-config\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366881 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-etc-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.368612 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366871 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/bba5a29c-b602-441c-a56e-c9f99d86d642-os-release\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-os-release\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366952 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sttz4\" (UniqueName: \"kubernetes.io/projected/11c19c14-8520-4178-b78d-91853fbb6218-kube-api-access-sttz4\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.366978 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wklc5\" (UniqueName: \"kubernetes.io/projected/abea0031-a712-49b4-8bd5-fff810a656de-kube-api-access-wklc5\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/abea0031-a712-49b4-8bd5-fff810a656de-socket-dir\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367014 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/853b0783-7a26-4123-b273-4626446e2285-konnectivity-ca\") pod \"konnectivity-agent-frgw7\" (UID: \"853b0783-7a26-4123-b273-4626446e2285\") " pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367049 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-etc-openvswitch\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367075 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-os-release\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367108 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0937ba0e-fe91-485f-859b-9b2e83aa6037-hosts-file\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367139 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-tuned\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367158 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0937ba0e-fe91-485f-859b-9b2e83aa6037-hosts-file\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367163 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-cni-multus\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367226 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-conf-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367250 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysctl-d\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367273 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-ovnkube-config\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367251 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-var-lib-cni-multus\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367288 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-multus-conf-dir\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367298 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-multus-certs\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.369374 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-749rv\" (UniqueName: \"kubernetes.io/projected/581936ef-d2cd-49ad-a3c1-53f962e87c81-kube-api-access-749rv\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-kubelet\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367391 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-sysctl-d\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367395 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-systemd\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/11c19c14-8520-4178-b78d-91853fbb6218-host-run-multus-certs\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367471 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-run-systemd\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367476 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-kubelet\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367423 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkcw4\" (UniqueName: \"kubernetes.io/projected/d9b84275-38aa-4e56-9200-37a23b9d41f9-kube-api-access-gkcw4\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367517 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/207739af-5203-470c-a881-a7dd9ae61e8a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367537 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-dbus\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367623 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-dbus\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.367723 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/207739af-5203-470c-a881-a7dd9ae61e8a-ovnkube-config\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.370257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.369901 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca26787a-aee8-493b-a8da-3e16abe3062f-tmp\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.371083 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.371041 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/207739af-5203-470c-a881-a7dd9ae61e8a-ovn-node-metrics-cert\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.371366 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.371228 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/853b0783-7a26-4123-b273-4626446e2285-agent-certs\") pod \"konnectivity-agent-frgw7\" (UID: \"853b0783-7a26-4123-b273-4626446e2285\") " pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.371642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.371612 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ca26787a-aee8-493b-a8da-3e16abe3062f-etc-tuned\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.375618 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.375537 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:40.375618 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.375564 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:40.375618 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.375578 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:40.375930 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.375663 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:30:40.875643551 +0000 UTC m=+3.058390428 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:40.382776 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.382695 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-749rv\" (UniqueName: \"kubernetes.io/projected/581936ef-d2cd-49ad-a3c1-53f962e87c81-kube-api-access-749rv\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.383537 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.383490 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sttz4\" (UniqueName: \"kubernetes.io/projected/11c19c14-8520-4178-b78d-91853fbb6218-kube-api-access-sttz4\") pod \"multus-zljtj\" (UID: \"11c19c14-8520-4178-b78d-91853fbb6218\") " pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.384444 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.384398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9nzhp\" (UniqueName: \"kubernetes.io/projected/bba5a29c-b602-441c-a56e-c9f99d86d642-kube-api-access-9nzhp\") pod \"multus-additional-cni-plugins-gsvjt\" (UID: \"bba5a29c-b602-441c-a56e-c9f99d86d642\") " pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.385400 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.384979 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkcw4\" (UniqueName: \"kubernetes.io/projected/d9b84275-38aa-4e56-9200-37a23b9d41f9-kube-api-access-gkcw4\") pod \"iptables-alerter-r52bh\" (UID: \"d9b84275-38aa-4e56-9200-37a23b9d41f9\") " pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.385400 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.384982 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n6j4\" (UniqueName: \"kubernetes.io/projected/207739af-5203-470c-a881-a7dd9ae61e8a-kube-api-access-7n6j4\") pod \"ovnkube-node-7w99l\" (UID: \"207739af-5203-470c-a881-a7dd9ae61e8a\") " pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.385400 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.385358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l448c\" (UniqueName: \"kubernetes.io/projected/0937ba0e-fe91-485f-859b-9b2e83aa6037-kube-api-access-l448c\") pod \"node-resolver-pj7xj\" (UID: \"0937ba0e-fe91-485f-859b-9b2e83aa6037\") " pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.385400 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.385364 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k48lt\" (UniqueName: \"kubernetes.io/projected/ca26787a-aee8-493b-a8da-3e16abe3062f-kube-api-access-k48lt\") pod \"tuned-wl8fw\" (UID: \"ca26787a-aee8-493b-a8da-3e16abe3062f\") " pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.387242 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.387199 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mf2j\" (UniqueName: \"kubernetes.io/projected/acc2e68a-d850-4802-b0e0-a67a809a0d08-kube-api-access-7mf2j\") pod \"node-ca-p497s\" (UID: \"acc2e68a-d850-4802-b0e0-a67a809a0d08\") " pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.388353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.388329 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wklc5\" (UniqueName: \"kubernetes.io/projected/abea0031-a712-49b4-8bd5-fff810a656de-kube-api-access-wklc5\") pod \"aws-ebs-csi-driver-node-pdqj6\" (UID: \"abea0031-a712-49b4-8bd5-fff810a656de\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.422421 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.422389 2564 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:40.440177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.440027 2564 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 07 14:30:40.501775 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.501714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" event={"ID":"0ab78a6284d85a2a04f046f66c180936","Type":"ContainerStarted","Data":"30cd191dcca195ca90186abfc3cc497d346b5f2e8018d0df13a516d9d7ef8377"} Jul 07 14:30:40.502922 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.502870 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" event={"ID":"12c88708317f1b5944d421053e667ab6","Type":"ContainerStarted","Data":"a0ee08dd02eba2597b62b1a1fe264a0a108c7d48ab2e4ffab04d67e3c1e7d250"} Jul 07 14:30:40.514668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.514636 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" Jul 07 14:30:40.523917 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.523707 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" Jul 07 14:30:40.526417 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.526387 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbba5a29c_b602_441c_a56e_c9f99d86d642.slice/crio-1aa71c6b35390fb22a6b10c73def36bbaadd7265c5f3221b1ccb9c2d68da485c WatchSource:0}: Error finding container 1aa71c6b35390fb22a6b10c73def36bbaadd7265c5f3221b1ccb9c2d68da485c: Status 404 returned error can't find the container with id 1aa71c6b35390fb22a6b10c73def36bbaadd7265c5f3221b1ccb9c2d68da485c Jul 07 14:30:40.534624 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.532481 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-r52bh" Jul 07 14:30:40.534624 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.533981 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca26787a_aee8_493b_a8da_3e16abe3062f.slice/crio-51876c6df32dc3a7454c3e5b1e5f09b32744c477460a2c271ff597e94421dd63 WatchSource:0}: Error finding container 51876c6df32dc3a7454c3e5b1e5f09b32744c477460a2c271ff597e94421dd63: Status 404 returned error can't find the container with id 51876c6df32dc3a7454c3e5b1e5f09b32744c477460a2c271ff597e94421dd63 Jul 07 14:30:40.540565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.540539 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" Jul 07 14:30:40.543602 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.543535 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b84275_38aa_4e56_9200_37a23b9d41f9.slice/crio-c0dd1b6d00bc5562dc0b918c3f29f44e29ad190871965e0ea82d46a99a5cac24 WatchSource:0}: Error finding container c0dd1b6d00bc5562dc0b918c3f29f44e29ad190871965e0ea82d46a99a5cac24: Status 404 returned error can't find the container with id c0dd1b6d00bc5562dc0b918c3f29f44e29ad190871965e0ea82d46a99a5cac24 Jul 07 14:30:40.547410 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.547386 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p497s" Jul 07 14:30:40.549579 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.549555 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabea0031_a712_49b4_8bd5_fff810a656de.slice/crio-2a3ba1a3e7f2ba94ae6218224235e0810dd457db433817582164b0e9e7260801 WatchSource:0}: Error finding container 2a3ba1a3e7f2ba94ae6218224235e0810dd457db433817582164b0e9e7260801: Status 404 returned error can't find the container with id 2a3ba1a3e7f2ba94ae6218224235e0810dd457db433817582164b0e9e7260801 Jul 07 14:30:40.553596 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.553568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:30:40.556732 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.556708 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacc2e68a_d850_4802_b0e0_a67a809a0d08.slice/crio-b3cc468565a8ca89060b0341bd0df6fd410ec2c81f4b5d9b267a5836938ab578 WatchSource:0}: Error finding container b3cc468565a8ca89060b0341bd0df6fd410ec2c81f4b5d9b267a5836938ab578: Status 404 returned error can't find the container with id b3cc468565a8ca89060b0341bd0df6fd410ec2c81f4b5d9b267a5836938ab578 Jul 07 14:30:40.562000 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.561975 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod207739af_5203_470c_a881_a7dd9ae61e8a.slice/crio-d10bd37aa27d7c0a608d634129c7dadbff1f539bfe31ac8799470c065bd0c521 WatchSource:0}: Error finding container d10bd37aa27d7c0a608d634129c7dadbff1f539bfe31ac8799470c065bd0c521: Status 404 returned error can't find the container with id d10bd37aa27d7c0a608d634129c7dadbff1f539bfe31ac8799470c065bd0c521 Jul 07 14:30:40.564505 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.564485 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:40.572164 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.572135 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zljtj" Jul 07 14:30:40.573766 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.573742 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853b0783_7a26_4123_b273_4626446e2285.slice/crio-aaf3aeda4c1e50e71cb8c497070db7b2b11a532140b5f7d12d6bed1feddc1b75 WatchSource:0}: Error finding container aaf3aeda4c1e50e71cb8c497070db7b2b11a532140b5f7d12d6bed1feddc1b75: Status 404 returned error can't find the container with id aaf3aeda4c1e50e71cb8c497070db7b2b11a532140b5f7d12d6bed1feddc1b75 Jul 07 14:30:40.577853 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.577826 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pj7xj" Jul 07 14:30:40.587005 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.586714 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c19c14_8520_4178_b78d_91853fbb6218.slice/crio-9331610a06af056d43122d77c0f21e05e223467f56f70e996b8e486f18307076 WatchSource:0}: Error finding container 9331610a06af056d43122d77c0f21e05e223467f56f70e996b8e486f18307076: Status 404 returned error can't find the container with id 9331610a06af056d43122d77c0f21e05e223467f56f70e996b8e486f18307076 Jul 07 14:30:40.589641 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:30:40.589594 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0937ba0e_fe91_485f_859b_9b2e83aa6037.slice/crio-86b4765f4f7692844f08f48ca3002672d5effd22169bc3ea3bdda1fdc9884931 WatchSource:0}: Error finding container 86b4765f4f7692844f08f48ca3002672d5effd22169bc3ea3bdda1fdc9884931: Status 404 returned error can't find the container with id 86b4765f4f7692844f08f48ca3002672d5effd22169bc3ea3bdda1fdc9884931 Jul 07 14:30:40.871066 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.870986 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:40.871227 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.871084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:40.871227 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.871107 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:40.871227 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.871186 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:41.871164927 +0000 UTC m=+4.053911781 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:40.871227 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.871185 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:40.871227 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.871222 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:41.871215424 +0000 UTC m=+4.053962276 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:40.971790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:40.971739 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:40.971997 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.971979 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:40.972070 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.972007 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:40.972070 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.972021 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:40.972163 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:40.972091 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:30:41.972069932 +0000 UTC m=+4.154816800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:41.300408 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.300278 2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 14:25:39 +0000 UTC" deadline="2028-03-07 08:09:34.766991702 +0000 UTC" Jul 07 14:30:41.300408 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.300349 2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14609h38m53.466647364s" Jul 07 14:30:41.496817 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.496294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:41.496817 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.496308 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:41.496817 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.496440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:41.496817 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.496790 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:41.511046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.510980 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pj7xj" event={"ID":"0937ba0e-fe91-485f-859b-9b2e83aa6037","Type":"ContainerStarted","Data":"86b4765f4f7692844f08f48ca3002672d5effd22169bc3ea3bdda1fdc9884931"} Jul 07 14:30:41.518681 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.518640 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zljtj" event={"ID":"11c19c14-8520-4178-b78d-91853fbb6218","Type":"ContainerStarted","Data":"9331610a06af056d43122d77c0f21e05e223467f56f70e996b8e486f18307076"} Jul 07 14:30:41.522668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.522502 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"d10bd37aa27d7c0a608d634129c7dadbff1f539bfe31ac8799470c065bd0c521"} Jul 07 14:30:41.528260 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.528202 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r52bh" event={"ID":"d9b84275-38aa-4e56-9200-37a23b9d41f9","Type":"ContainerStarted","Data":"c0dd1b6d00bc5562dc0b918c3f29f44e29ad190871965e0ea82d46a99a5cac24"} Jul 07 14:30:41.533218 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.533188 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" event={"ID":"ca26787a-aee8-493b-a8da-3e16abe3062f","Type":"ContainerStarted","Data":"51876c6df32dc3a7454c3e5b1e5f09b32744c477460a2c271ff597e94421dd63"} Jul 07 14:30:41.535349 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.535237 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-frgw7" event={"ID":"853b0783-7a26-4123-b273-4626446e2285","Type":"ContainerStarted","Data":"aaf3aeda4c1e50e71cb8c497070db7b2b11a532140b5f7d12d6bed1feddc1b75"} Jul 07 14:30:41.539455 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.539336 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p497s" event={"ID":"acc2e68a-d850-4802-b0e0-a67a809a0d08","Type":"ContainerStarted","Data":"b3cc468565a8ca89060b0341bd0df6fd410ec2c81f4b5d9b267a5836938ab578"} Jul 07 14:30:41.542871 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.542764 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" event={"ID":"abea0031-a712-49b4-8bd5-fff810a656de","Type":"ContainerStarted","Data":"2a3ba1a3e7f2ba94ae6218224235e0810dd457db433817582164b0e9e7260801"} Jul 07 14:30:41.546613 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.546538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerStarted","Data":"1aa71c6b35390fb22a6b10c73def36bbaadd7265c5f3221b1ccb9c2d68da485c"} Jul 07 14:30:41.880378 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.880331 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:41.880563 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.880392 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:41.880563 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.880531 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:41.880702 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.880598 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:43.88057877 +0000 UTC m=+6.063325640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:41.881057 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.881033 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:41.881139 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.881096 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:43.881080774 +0000 UTC m=+6.063827628 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:41.981577 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:41.981536 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:41.981757 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.981714 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:41.981757 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.981739 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:41.981757 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.981753 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:41.981915 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:41.981822 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:30:43.981801741 +0000 UTC m=+6.164548598 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:42.498673 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:42.498384 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:42.499171 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:42.498742 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:42.562405 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:42.562364 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" event={"ID":"12c88708317f1b5944d421053e667ab6","Type":"ContainerStarted","Data":"03580b56dc5858112f0a878b955745d167761486e3d374b0cf080ccfd459ce1c"} Jul 07 14:30:42.577206 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:42.577140 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-116.ec2.internal" podStartSLOduration=3.577120616 podStartE2EDuration="3.577120616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:42.576959001 +0000 UTC m=+4.759705872" watchObservedRunningTime="2026-07-07 14:30:42.577120616 +0000 UTC m=+4.759867489" Jul 07 14:30:43.496999 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.496460 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:43.496999 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.496607 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:43.496999 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.496687 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:43.496999 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.496764 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:43.572292 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.571090 2564 generic.go:356] "Generic (PLEG): container finished" podID="0ab78a6284d85a2a04f046f66c180936" containerID="55a18f427d3ad08113ea3a6fe20e1917bdcc10cd58149eff0ac980a84ff3955d" exitCode=0 Jul 07 14:30:43.572292 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.572001 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" event={"ID":"0ab78a6284d85a2a04f046f66c180936","Type":"ContainerDied","Data":"55a18f427d3ad08113ea3a6fe20e1917bdcc10cd58149eff0ac980a84ff3955d"} Jul 07 14:30:43.897172 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.897083 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:43.897172 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.897129 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:43.897341 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.897264 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:43.897341 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.897321 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:47.897303063 +0000 UTC m=+10.080049926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:43.897730 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.897688 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:43.897780 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.897738 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:47.897722521 +0000 UTC m=+10.080469374 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:43.997902 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:43.997868 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:43.998156 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.998137 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:43.998240 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.998166 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:43.998240 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.998178 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:43.998240 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:43.998232 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:30:47.998214803 +0000 UTC m=+10.180961664 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:44.496115 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:44.496082 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:44.496313 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:44.496236 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:45.496364 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:45.496271 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:45.496364 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:45.496329 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:45.496841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:45.496412 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:45.496841 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:45.496541 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:46.498896 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:46.497330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:46.498896 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:46.497475 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:47.497081 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:47.496571 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:47.497081 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:47.496600 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:47.497081 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:47.496703 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:47.497081 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:47.496872 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:47.932417 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:47.932325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:47.932417 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:47.932375 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:47.932919 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:47.932502 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:47.932919 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:47.932563 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:55.932549898 +0000 UTC m=+18.115296750 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:47.932919 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:47.932502 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:47.932919 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:47.932638 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:30:55.932625516 +0000 UTC m=+18.115372364 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:48.032886 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:48.032852 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:48.033089 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:48.033056 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:48.033089 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:48.033077 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:48.033089 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:48.033088 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:48.033246 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:48.033146 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:30:56.033129409 +0000 UTC m=+18.215876273 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:48.497870 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:48.497464 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:48.497870 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:48.497597 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:49.496745 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:49.496568 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:49.496745 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:49.496623 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:49.496745 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:49.496707 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:49.497325 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:49.496843 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:50.496762 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:50.496650 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:50.497694 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:50.497327 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:51.497747 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.497146 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:51.497747 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.497303 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:51.497747 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:51.497385 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:51.498478 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:51.498417 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:51.588160 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.588121 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-frgw7" event={"ID":"853b0783-7a26-4123-b273-4626446e2285","Type":"ContainerStarted","Data":"d03aa0f10dc8a8a7e209d577a8acf5f3408a6141ce45fc44f611f2ef9edc4af6"} Jul 07 14:30:51.589579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.589518 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" event={"ID":"abea0031-a712-49b4-8bd5-fff810a656de","Type":"ContainerStarted","Data":"74ced1a7738149874c01f7bc9d2bbc68e6159af78b8a41665806d2a63e726fe2"} Jul 07 14:30:51.591053 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.591028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerStarted","Data":"76bb968da6b359ec993fe7eb41fdff5bec6bcfd1fdf32030c6e7140398a85dd9"} Jul 07 14:30:51.596574 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.596538 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" event={"ID":"0ab78a6284d85a2a04f046f66c180936","Type":"ContainerStarted","Data":"865585defe973f874a4dd06c9325b6792e94673f3986f1a696880d30e29fc05d"} Jul 07 14:30:51.598067 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.598042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pj7xj" event={"ID":"0937ba0e-fe91-485f-859b-9b2e83aa6037","Type":"ContainerStarted","Data":"f0562de4d7849ad6dad5175251b1fa19fc04f0528e8bb281b51ad107f34fab73"} Jul 07 14:30:51.603928 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.603813 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-frgw7" podStartSLOduration=2.872852721 podStartE2EDuration="13.603800895s" totalImagesPullingTime="10.730948174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:51.603241742 +0000 UTC m=+13.785988610" watchObservedRunningTime="2026-07-07 14:30:51.603800895 +0000 UTC m=+13.786547764" Jul 07 14:30:51.617794 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.617754 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pj7xj" podStartSLOduration=2.902731664 podStartE2EDuration="13.61773938s" totalImagesPullingTime="10.715007716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:51.617725871 +0000 UTC m=+13.800472755" watchObservedRunningTime="2026-07-07 14:30:51.61773938 +0000 UTC m=+13.800486249" Jul 07 14:30:51.655553 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:51.655491 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-116.ec2.internal" podStartSLOduration=12.655467095 podStartE2EDuration="12.655467095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:51.655185375 +0000 UTC m=+13.837932245" watchObservedRunningTime="2026-07-07 14:30:51.655467095 +0000 UTC m=+13.838213967" Jul 07 14:30:52.440950 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:52.440810 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:52.441570 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:52.441547 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:52.495999 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:52.495895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:52.496164 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:52.496033 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:52.600628 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:52.600581 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:52.601143 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:52.601000 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-frgw7" Jul 07 14:30:53.496023 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:53.495923 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:53.496185 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:53.495927 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:53.496185 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:53.496064 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:53.496185 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:53.496174 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:53.604056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:53.604020 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-r52bh" event={"ID":"d9b84275-38aa-4e56-9200-37a23b9d41f9","Type":"ContainerStarted","Data":"8bab2304c3a37c25e332947291caf12f1736544976100d77cb3c371ba12842a8"} Jul 07 14:30:53.620022 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:53.619967 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-r52bh" podStartSLOduration=4.859319127 podStartE2EDuration="15.619932083s" totalImagesPullingTime="10.760612956s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:30:53.619650671 +0000 UTC m=+15.802397542" watchObservedRunningTime="2026-07-07 14:30:53.619932083 +0000 UTC m=+15.802678956" Jul 07 14:30:54.496469 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:54.496222 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:54.496639 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:54.496577 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:55.496151 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:55.496115 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:55.496677 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:55.496129 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:55.496677 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:55.496246 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:55.496677 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:55.496307 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:56.000676 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:56.000638 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:56.000676 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:56.000681 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:56.000906 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.000782 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:56.000906 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.000782 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:56.000906 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.000835 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:12.000820961 +0000 UTC m=+34.183567830 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:30:56.000906 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.000847 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:12.000841337 +0000 UTC m=+34.183588196 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:30:56.101594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:56.101539 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:56.101782 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.101742 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:30:56.101782 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.101769 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:30:56.101782 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.101780 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:56.101931 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.101849 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:31:12.101829409 +0000 UTC m=+34.284576274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:30:56.500420 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:56.500391 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:56.500959 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:56.500538 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:56.611450 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:56.611412 2564 generic.go:356] "Generic (PLEG): container finished" podID="bba5a29c-b602-441c-a56e-c9f99d86d642" containerID="76bb968da6b359ec993fe7eb41fdff5bec6bcfd1fdf32030c6e7140398a85dd9" exitCode=0 Jul 07 14:30:56.611450 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:56.611463 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerDied","Data":"76bb968da6b359ec993fe7eb41fdff5bec6bcfd1fdf32030c6e7140398a85dd9"} Jul 07 14:30:57.496105 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:57.496071 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:57.496310 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:57.496193 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:57.496310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:57.496240 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:57.496408 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:57.496307 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:30:58.496908 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:58.496858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:30:58.497512 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:58.497002 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:30:59.495930 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:59.495878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:30:59.495930 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:30:59.495921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:30:59.496197 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:59.496033 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:30:59.496197 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:30:59.496143 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:00.497038 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.496760 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:00.498007 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:00.497158 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:00.623609 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.623566 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zljtj" event={"ID":"11c19c14-8520-4178-b78d-91853fbb6218","Type":"ContainerStarted","Data":"9ebf9ec7c4a7f16642c9550b48efecbee998a9878b12ae6a7e2dbdbb5bbf7aaa"} Jul 07 14:31:00.629714 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.629685 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" event={"ID":"ca26787a-aee8-493b-a8da-3e16abe3062f","Type":"ContainerStarted","Data":"b9bf0b7d3cda21795a131141eda86f3bac8ddab0d8685fe71115845cf0b84a2b"} Jul 07 14:31:00.631577 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.631525 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p497s" event={"ID":"acc2e68a-d850-4802-b0e0-a67a809a0d08","Type":"ContainerStarted","Data":"e8b77c6d97175928c9ed1cd295976d0d1c50bd67a3c931ea2c9083516c5e4714"} Jul 07 14:31:00.643604 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.643559 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zljtj" podStartSLOduration=2.964509558 podStartE2EDuration="22.643542978s" totalImagesPullingTime="19.67903342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:00.642961873 +0000 UTC m=+22.825708740" watchObservedRunningTime="2026-07-07 14:31:00.643542978 +0000 UTC m=+22.826289848" Jul 07 14:31:00.662836 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.662790 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-wl8fw" podStartSLOduration=2.932696793 podStartE2EDuration="22.662772873s" totalImagesPullingTime="19.73007608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:00.662213932 +0000 UTC m=+22.844960796" watchObservedRunningTime="2026-07-07 14:31:00.662772873 +0000 UTC m=+22.845519744" Jul 07 14:31:00.764838 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:00.764810 2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 07 14:31:01.325228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.325135 2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T14:31:00.764832416Z","UUID":"64f3101e-6f2f-4c0d-87a5-8d7663d1ff56","Handler":null,"Name":"","Endpoint":""} Jul 07 14:31:01.326918 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.326886 2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 07 14:31:01.327072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.326956 2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 07 14:31:01.497068 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.496802 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:01.497482 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.496814 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:01.497482 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:01.497090 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:01.497482 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:01.497165 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:01.635617 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.635580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" event={"ID":"abea0031-a712-49b4-8bd5-fff810a656de","Type":"ContainerStarted","Data":"accbf3e731d4e43d711caa809bf50295613efe55d9c8d9640e9d62f08630da15"} Jul 07 14:31:01.638413 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.638386 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"e462f7170f2c6931db266303c6c3053e27e3ecc31229ed4f6948127dbe5f39f5"} Jul 07 14:31:01.638543 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.638449 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"1c5f1451323a190c04d452229e2eafb30f1bb89317ff7f9b36e31ae3cbbe8f48"} Jul 07 14:31:01.638543 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.638487 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"b6d045701b337ad32adb0c61479a3d5eb9b955c31cea9cabe763a4561023ece4"} Jul 07 14:31:01.638543 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.638516 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"4a39823da63386372142efe6734fe5560eb08120df8f132b43214dbcdd7e88ba"} Jul 07 14:31:01.638638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.638550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"33fec96270ac3df24572e0e939d9e421f060f03744acf7351fd72bdd63c24963"} Jul 07 14:31:01.638638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:01.638580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"c05c04ff14776d884ed3bc6e1c605321361f4078b3202558767e08d2342dbfc9"} Jul 07 14:31:02.496139 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:02.496099 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:02.496433 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:02.496245 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:03.495904 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:03.495870 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:03.496371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:03.495877 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:03.496371 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:03.496034 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:03.496371 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:03.496130 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:03.645470 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:03.645376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" event={"ID":"abea0031-a712-49b4-8bd5-fff810a656de","Type":"ContainerStarted","Data":"edb6a09174bdd7662041695e72b3e96509cf3e957ab80664254723b8e3ad9989"} Jul 07 14:31:03.649254 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:03.649225 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"9eaeecfe3c51e249e0b87d3c921937f2915b2f6ea01d9473e0947d051b67bf7f"} Jul 07 14:31:03.663739 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:03.663684 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-pdqj6" podStartSLOduration=3.783293739 podStartE2EDuration="25.66366366s" totalImagesPullingTime="21.880369921s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:03.663117106 +0000 UTC m=+25.845863977" watchObservedRunningTime="2026-07-07 14:31:03.66366366 +0000 UTC m=+25.846410532" Jul 07 14:31:03.663916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:03.663869 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p497s" podStartSLOduration=14.796634575 podStartE2EDuration="25.663862291s" totalImagesPullingTime="10.867227716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:00.677992434 +0000 UTC m=+22.860739305" watchObservedRunningTime="2026-07-07 14:31:03.663862291 +0000 UTC m=+25.846609160" Jul 07 14:31:04.496270 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:04.496231 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:04.496874 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:04.496398 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:04.515975 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:04.515932 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pj7xj_0937ba0e-fe91-485f-859b-9b2e83aa6037/dns-node-resolver/0.log" Jul 07 14:31:05.490251 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:05.490227 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p497s_acc2e68a-d850-4802-b0e0-a67a809a0d08/node-ca/0.log" Jul 07 14:31:05.496450 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:05.496428 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:05.496753 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:05.496534 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:05.496753 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:05.496582 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:05.496753 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:05.496671 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:05.659244 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:05.659004 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" event={"ID":"207739af-5203-470c-a881-a7dd9ae61e8a","Type":"ContainerStarted","Data":"81d597e3c45fd8f7d29f5fff1429c5ab870d9a97fc17dee70619628f9b21290d"} Jul 07 14:31:06.496694 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.496498 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:06.497358 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:06.496782 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:06.662854 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.662820 2564 generic.go:356] "Generic (PLEG): container finished" podID="bba5a29c-b602-441c-a56e-c9f99d86d642" containerID="c45b5f74938989c643b76bb7f23062413b3fc5c2dbd33643dadbbe0295e259fe" exitCode=0 Jul 07 14:31:06.663077 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.662889 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerDied","Data":"c45b5f74938989c643b76bb7f23062413b3fc5c2dbd33643dadbbe0295e259fe"} Jul 07 14:31:06.663320 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.663291 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:31:06.663405 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.663357 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:31:06.663452 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.663427 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:31:06.678701 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.678678 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:31:06.678806 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.678774 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:31:06.691387 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:06.691344 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" podStartSLOduration=8.624511302 podStartE2EDuration="28.691332349s" totalImagesPullingTime="20.066821047s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:06.691044714 +0000 UTC m=+28.873791584" watchObservedRunningTime="2026-07-07 14:31:06.691332349 +0000 UTC m=+28.874079218" Jul 07 14:31:07.496535 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.496507 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:07.496744 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.496510 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:07.496744 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:07.496615 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:07.496744 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:07.496722 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:07.730777 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.730742 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kq895"] Jul 07 14:31:07.730971 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.730958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:07.731119 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:07.731088 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:07.736620 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.736353 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-45vm5"] Jul 07 14:31:07.736620 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.736475 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:07.736620 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:07.736568 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:07.736620 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.736583 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gqsjh"] Jul 07 14:31:07.736895 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:07.736661 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:07.736895 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:07.736744 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:08.669382 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:08.669347 2564 generic.go:356] "Generic (PLEG): container finished" podID="bba5a29c-b602-441c-a56e-c9f99d86d642" containerID="2b95f2874ead51bb6df69b47c5cf8ed0a349ddc12cc4d90c0896254a16848c78" exitCode=0 Jul 07 14:31:08.669818 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:08.669421 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerDied","Data":"2b95f2874ead51bb6df69b47c5cf8ed0a349ddc12cc4d90c0896254a16848c78"} Jul 07 14:31:09.496138 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:09.496094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:09.496138 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:09.496137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:09.496375 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:09.496137 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:09.496375 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:09.496250 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:09.496375 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:09.496330 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:09.496492 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:09.496423 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:10.678108 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:10.677837 2564 generic.go:356] "Generic (PLEG): container finished" podID="bba5a29c-b602-441c-a56e-c9f99d86d642" containerID="473bf6a8a00897cd80448e0cdbc2cbab62cb373a5eb15ad3225129edff831760" exitCode=0 Jul 07 14:31:10.678108 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:10.677914 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerDied","Data":"473bf6a8a00897cd80448e0cdbc2cbab62cb373a5eb15ad3225129edff831760"} Jul 07 14:31:11.495920 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:11.495886 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:11.496116 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:11.495885 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:11.496116 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:11.495895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:11.496184 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:11.496108 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:11.496216 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:11.496177 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:11.496216 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:11.496023 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:12.020595 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:12.020562 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:12.020595 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:12.020597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:12.021081 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.020714 2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:31:12.021081 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.020756 2564 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 07 14:31:12.021081 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.020771 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs podName:581936ef-d2cd-49ad-a3c1-53f962e87c81 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:44.020754058 +0000 UTC m=+66.203500908 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs") pod "network-metrics-daemon-gqsjh" (UID: "581936ef-d2cd-49ad-a3c1-53f962e87c81") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 07 14:31:12.021081 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.020841 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret podName:f46e0533-6a2b-44aa-aaaf-d95fe0a32be0 nodeName:}" failed. No retries permitted until 2026-07-07 14:31:44.020821934 +0000 UTC m=+66.203568782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret") pod "global-pull-secret-syncer-kq895" (UID: "f46e0533-6a2b-44aa-aaaf-d95fe0a32be0") : object "kube-system"/"original-pull-secret" not registered Jul 07 14:31:12.121557 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:12.121516 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:12.121751 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.121700 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 07 14:31:12.121751 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.121727 2564 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 07 14:31:12.121751 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.121739 2564 projected.go:196] Error preparing data for projected volume kube-api-access-9m8vh for pod openshift-network-diagnostics/network-check-target-45vm5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:31:12.121906 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:12.121806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh podName:12e5ead1-431e-4985-bf33-154606cc50da nodeName:}" failed. No retries permitted until 2026-07-07 14:31:44.121785575 +0000 UTC m=+66.304532442 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9m8vh" (UniqueName: "kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh") pod "network-check-target-45vm5" (UID: "12e5ead1-431e-4985-bf33-154606cc50da") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 07 14:31:13.496771 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:13.496734 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:13.497309 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:13.496864 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:13.497309 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:13.496920 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:13.497309 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:13.496958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:13.497309 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:13.497067 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:13.497309 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:13.497218 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:15.496504 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:15.496469 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:15.496932 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:15.496473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:15.496932 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:15.496480 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:15.496932 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:15.496600 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:15.496932 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:15.496705 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:15.496932 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:15.496781 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:17.496394 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:17.496351 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:17.496901 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:17.496401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:17.496901 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:17.496401 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:17.496901 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:17.496476 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:17.496901 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:17.496575 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:17.496901 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:17.496626 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:18.699616 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:18.699581 2564 generic.go:356] "Generic (PLEG): container finished" podID="bba5a29c-b602-441c-a56e-c9f99d86d642" containerID="e7df32eb11b6adf4eceb333d1e4d702daf3be386e3b5ee7395dac2fac55d6390" exitCode=0 Jul 07 14:31:18.700175 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:18.699656 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerDied","Data":"e7df32eb11b6adf4eceb333d1e4d702daf3be386e3b5ee7395dac2fac55d6390"} Jul 07 14:31:19.496132 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:19.496094 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:19.496132 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:19.496128 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:19.496328 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:19.496129 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:19.496328 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:19.496210 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:19.496328 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:19.496279 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:19.496460 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:19.496340 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:19.704714 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:19.704682 2564 generic.go:356] "Generic (PLEG): container finished" podID="bba5a29c-b602-441c-a56e-c9f99d86d642" containerID="342a014f87f26bb8336d0ff53330d647220ae57078862576cb6ad18b44f10215" exitCode=0 Jul 07 14:31:19.704714 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:19.704721 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerDied","Data":"342a014f87f26bb8336d0ff53330d647220ae57078862576cb6ad18b44f10215"} Jul 07 14:31:20.712115 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:20.712083 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" event={"ID":"bba5a29c-b602-441c-a56e-c9f99d86d642","Type":"ContainerStarted","Data":"4e46de72707c0437c17191955390d1eb58eb45065732f121bc582fc83529f712"} Jul 07 14:31:21.496644 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:21.496603 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:21.496818 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:21.496713 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:21.496818 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:21.496615 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:21.496920 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:21.496738 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:21.496920 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:21.496824 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:21.497040 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:21.496928 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:23.496674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:23.496634 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:23.497157 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:23.496641 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:23.497157 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:23.496747 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:23.497157 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:23.496642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:23.497157 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:23.496815 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:23.497157 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:23.496885 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:25.496646 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:25.496612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:25.496646 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:25.496642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:25.497075 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:25.496720 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:25.497075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:25.496757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:25.497075 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:25.496830 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:25.497075 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:25.496902 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:27.496556 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:27.496516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:27.496980 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:27.496519 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:27.496980 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:27.496636 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:27.496980 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:27.496688 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:27.496980 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:27.496516 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:27.496980 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:27.496784 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:29.496012 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:29.495970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:29.496012 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:29.496007 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:29.496453 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:29.495970 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:29.496453 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:29.496098 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:29.496453 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:29.496153 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:29.496453 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:29.496221 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:31.496703 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:31.496667 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:31.497224 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:31.496711 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:31.497224 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:31.496762 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:31.497224 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:31.496772 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:31.497224 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:31.496820 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:31.497224 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:31.496912 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:33.496630 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:33.496590 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:33.497100 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:33.496590 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:33.497100 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:33.496693 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:33.497100 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:33.496590 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:33.497100 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:33.496771 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:33.497100 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:33.496856 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:35.496217 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:35.496188 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:35.496679 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:35.496187 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:35.496679 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:35.496303 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:35.496679 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:35.496197 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:35.496679 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:35.496365 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:35.496679 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:35.496440 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:37.495996 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:37.495953 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:37.495996 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:37.495983 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:37.496506 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:37.495963 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:37.496506 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:37.496062 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kq895" podUID="f46e0533-6a2b-44aa-aaaf-d95fe0a32be0" Jul 07 14:31:37.496506 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:37.496208 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gqsjh" podUID="581936ef-d2cd-49ad-a3c1-53f962e87c81" Jul 07 14:31:37.496506 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:37.496244 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-45vm5" podUID="12e5ead1-431e-4985-bf33-154606cc50da" Jul 07 14:31:38.088360 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.088289 2564 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-116.ec2.internal" event="NodeReady" Jul 07 14:31:38.088498 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.088404 2564 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 07 14:31:38.136839 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.136306 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-gsvjt" podStartSLOduration=31.084150357 podStartE2EDuration="1m0.136282599s" totalImagesPullingTime="29.052132242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:20.739808545 +0000 UTC m=+42.922555416" watchObservedRunningTime="2026-07-07 14:31:38.136282599 +0000 UTC m=+60.319029474" Jul 07 14:31:38.137040 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.136996 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-54b78c87fb-cgkjh"] Jul 07 14:31:38.151174 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.151151 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.153852 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.153819 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:31:38.154018 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.153873 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:31:38.154018 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.153953 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c76h9\"" Jul 07 14:31:38.154018 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.154015 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:31:38.162150 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.162128 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:31:38.174850 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.174823 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d7kqh"] Jul 07 14:31:38.187782 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.187743 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b78c87fb-cgkjh"] Jul 07 14:31:38.187782 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.187790 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w22js"] Jul 07 14:31:38.188127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.187841 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.190373 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.190242 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 07 14:31:38.190373 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.190257 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 07 14:31:38.190373 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.190247 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 07 14:31:38.190373 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.190311 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 07 14:31:38.190373 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.190314 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-swbcl\"" Jul 07 14:31:38.197528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.197504 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d7kqh"] Jul 07 14:31:38.197651 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.197541 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w22js"] Jul 07 14:31:38.197651 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.197562 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.200518 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.200486 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 07 14:31:38.201108 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.201087 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 07 14:31:38.202122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.202022 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jh6qq\"" Jul 07 14:31:38.210574 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210552 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-registry-tls\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.210691 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210581 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03a7a5d3-cc26-4a79-af4a-915470b2a16e-crio-socket\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.210691 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210602 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57562010-e684-4a89-8d5f-a8c536aa93b9-tmp-dir\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.210776 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210685 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57562010-e684-4a89-8d5f-a8c536aa93b9-metrics-tls\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.210776 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210740 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-registry-certificates\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.210776 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03a7a5d3-cc26-4a79-af4a-915470b2a16e-data-volume\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.210927 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-bound-sa-token\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.210927 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210804 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhwxt\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-kube-api-access-vhwxt\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.210927 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210850 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-trusted-ca\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.210927 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210906 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03a7a5d3-cc26-4a79-af4a-915470b2a16e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210962 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-image-registry-private-configuration\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.210993 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-ca-trust-extracted\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.211022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55rhf\" (UniqueName: \"kubernetes.io/projected/03a7a5d3-cc26-4a79-af4a-915470b2a16e-kube-api-access-55rhf\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.211047 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57562010-e684-4a89-8d5f-a8c536aa93b9-config-volume\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.211074 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-installation-pull-secrets\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.211098 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03a7a5d3-cc26-4a79-af4a-915470b2a16e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.211148 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.211121 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm7x8\" (UniqueName: \"kubernetes.io/projected/57562010-e684-4a89-8d5f-a8c536aa93b9-kube-api-access-qm7x8\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.312418 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312383 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57562010-e684-4a89-8d5f-a8c536aa93b9-metrics-tls\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.312418 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-registry-certificates\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312452 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03a7a5d3-cc26-4a79-af4a-915470b2a16e-data-volume\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-bound-sa-token\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhwxt\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-kube-api-access-vhwxt\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-trusted-ca\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312558 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03a7a5d3-cc26-4a79-af4a-915470b2a16e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312586 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-image-registry-private-configuration\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312614 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-ca-trust-extracted\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312636 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55rhf\" (UniqueName: \"kubernetes.io/projected/03a7a5d3-cc26-4a79-af4a-915470b2a16e-kube-api-access-55rhf\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312658 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57562010-e684-4a89-8d5f-a8c536aa93b9-config-volume\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.312682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312683 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-installation-pull-secrets\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312705 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03a7a5d3-cc26-4a79-af4a-915470b2a16e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312732 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm7x8\" (UniqueName: \"kubernetes.io/projected/57562010-e684-4a89-8d5f-a8c536aa93b9-kube-api-access-qm7x8\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312759 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-registry-tls\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312782 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03a7a5d3-cc26-4a79-af4a-915470b2a16e-crio-socket\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57562010-e684-4a89-8d5f-a8c536aa93b9-tmp-dir\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.312859 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/03a7a5d3-cc26-4a79-af4a-915470b2a16e-data-volume\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.313195 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.313181 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/57562010-e684-4a89-8d5f-a8c536aa93b9-tmp-dir\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.313526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.313275 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-ca-trust-extracted\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.313526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.313323 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/57562010-e684-4a89-8d5f-a8c536aa93b9-config-volume\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.313526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.313358 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/03a7a5d3-cc26-4a79-af4a-915470b2a16e-crio-socket\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.313526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.313398 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-registry-certificates\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.313747 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.313729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/03a7a5d3-cc26-4a79-af4a-915470b2a16e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.316731 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.316706 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/03a7a5d3-cc26-4a79-af4a-915470b2a16e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.316830 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.316704 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/57562010-e684-4a89-8d5f-a8c536aa93b9-metrics-tls\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.329102 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.329069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 07 14:31:38.329280 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.329069 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 07 14:31:38.329280 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.329128 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 07 14:31:38.330046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.330029 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6sfrj"] Jul 07 14:31:38.332889 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.332872 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.335096 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.335069 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 07 14:31:38.335472 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.335452 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-image-registry-private-configuration\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.335774 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.335748 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-installation-pull-secrets\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.335915 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.335898 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-registry-tls\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.337768 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.337750 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 07 14:31:38.337861 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.337800 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 07 14:31:38.337861 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.337850 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8shmn\"" Jul 07 14:31:38.338190 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.338176 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 07 14:31:38.344783 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.344720 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-trusted-ca\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.345140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.345120 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6sfrj"] Jul 07 14:31:38.348122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.348090 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm7x8\" (UniqueName: \"kubernetes.io/projected/57562010-e684-4a89-8d5f-a8c536aa93b9-kube-api-access-qm7x8\") pod \"dns-default-w22js\" (UID: \"57562010-e684-4a89-8d5f-a8c536aa93b9\") " pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.351369 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.351309 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55rhf\" (UniqueName: \"kubernetes.io/projected/03a7a5d3-cc26-4a79-af4a-915470b2a16e-kube-api-access-55rhf\") pod \"insights-runtime-extractor-d7kqh\" (UID: \"03a7a5d3-cc26-4a79-af4a-915470b2a16e\") " pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.352748 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.352729 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-bound-sa-token\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.353068 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.353052 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhwxt\" (UniqueName: \"kubernetes.io/projected/c676a4a2-645c-4516-8ae0-e5cbdf51d3d6-kube-api-access-vhwxt\") pod \"image-registry-54b78c87fb-cgkjh\" (UID: \"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6\") " pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.413174 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.413143 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d340be2b-1247-4cb7-a464-71a80a7dac5b-cert\") pod \"ingress-canary-6sfrj\" (UID: \"d340be2b-1247-4cb7-a464-71a80a7dac5b\") " pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.413325 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.413208 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8d56\" (UniqueName: \"kubernetes.io/projected/d340be2b-1247-4cb7-a464-71a80a7dac5b-kube-api-access-g8d56\") pod \"ingress-canary-6sfrj\" (UID: \"d340be2b-1247-4cb7-a464-71a80a7dac5b\") " pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.467969 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.467923 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-c76h9\"" Jul 07 14:31:38.471000 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.470978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.501398 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.501357 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d7kqh" Jul 07 14:31:38.509654 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.509624 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w22js" Jul 07 14:31:38.514302 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.514254 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8d56\" (UniqueName: \"kubernetes.io/projected/d340be2b-1247-4cb7-a464-71a80a7dac5b-kube-api-access-g8d56\") pod \"ingress-canary-6sfrj\" (UID: \"d340be2b-1247-4cb7-a464-71a80a7dac5b\") " pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.514456 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.514347 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d340be2b-1247-4cb7-a464-71a80a7dac5b-cert\") pod \"ingress-canary-6sfrj\" (UID: \"d340be2b-1247-4cb7-a464-71a80a7dac5b\") " pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.516808 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.516749 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d340be2b-1247-4cb7-a464-71a80a7dac5b-cert\") pod \"ingress-canary-6sfrj\" (UID: \"d340be2b-1247-4cb7-a464-71a80a7dac5b\") " pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.523808 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.523778 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8d56\" (UniqueName: \"kubernetes.io/projected/d340be2b-1247-4cb7-a464-71a80a7dac5b-kube-api-access-g8d56\") pod \"ingress-canary-6sfrj\" (UID: \"d340be2b-1247-4cb7-a464-71a80a7dac5b\") " pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.644491 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.644454 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-54b78c87fb-cgkjh"] Jul 07 14:31:38.647654 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:38.647626 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc676a4a2_645c_4516_8ae0_e5cbdf51d3d6.slice/crio-1ce7ef4e7bcf63d93be50fbad73c4cc994acb190cac8cb2d03f7d1e6de2540bc WatchSource:0}: Error finding container 1ce7ef4e7bcf63d93be50fbad73c4cc994acb190cac8cb2d03f7d1e6de2540bc: Status 404 returned error can't find the container with id 1ce7ef4e7bcf63d93be50fbad73c4cc994acb190cac8cb2d03f7d1e6de2540bc Jul 07 14:31:38.648398 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.648380 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6sfrj" Jul 07 14:31:38.654139 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.654111 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d7kqh"] Jul 07 14:31:38.659196 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:38.659165 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03a7a5d3_cc26_4a79_af4a_915470b2a16e.slice/crio-dc5d007bc556f8a8bddfcc294c46b3fef5dee9542d030719b7fd69125c14b261 WatchSource:0}: Error finding container dc5d007bc556f8a8bddfcc294c46b3fef5dee9542d030719b7fd69125c14b261: Status 404 returned error can't find the container with id dc5d007bc556f8a8bddfcc294c46b3fef5dee9542d030719b7fd69125c14b261 Jul 07 14:31:38.671184 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.671156 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w22js"] Jul 07 14:31:38.680442 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:38.680409 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57562010_e684_4a89_8d5f_a8c536aa93b9.slice/crio-bec4a4bb51d58179beedbee0d128038a92c9d7965bbb4ec08da92aa7c8581fde WatchSource:0}: Error finding container bec4a4bb51d58179beedbee0d128038a92c9d7965bbb4ec08da92aa7c8581fde: Status 404 returned error can't find the container with id bec4a4bb51d58179beedbee0d128038a92c9d7965bbb4ec08da92aa7c8581fde Jul 07 14:31:38.683690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.683666 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7w99l" Jul 07 14:31:38.753711 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.753675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w22js" event={"ID":"57562010-e684-4a89-8d5f-a8c536aa93b9","Type":"ContainerStarted","Data":"bec4a4bb51d58179beedbee0d128038a92c9d7965bbb4ec08da92aa7c8581fde"} Jul 07 14:31:38.755492 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.755445 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" event={"ID":"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6","Type":"ContainerStarted","Data":"03ac2167b86dab2af46e6647b2e701bd1c4595e3774632bfb54ba84fd58a4ae3"} Jul 07 14:31:38.755492 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.755494 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" event={"ID":"c676a4a2-645c-4516-8ae0-e5cbdf51d3d6","Type":"ContainerStarted","Data":"1ce7ef4e7bcf63d93be50fbad73c4cc994acb190cac8cb2d03f7d1e6de2540bc"} Jul 07 14:31:38.755722 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.755518 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:31:38.756607 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.756584 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7kqh" event={"ID":"03a7a5d3-cc26-4a79-af4a-915470b2a16e","Type":"ContainerStarted","Data":"dc5d007bc556f8a8bddfcc294c46b3fef5dee9542d030719b7fd69125c14b261"} Jul 07 14:31:38.782689 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.782636 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" podStartSLOduration=1.782620885 podStartE2EDuration="1.782620885s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:38.782391192 +0000 UTC m=+60.965138074" watchObservedRunningTime="2026-07-07 14:31:38.782620885 +0000 UTC m=+60.965367754" Jul 07 14:31:38.788422 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:38.788375 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6sfrj"] Jul 07 14:31:38.790329 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:38.790306 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd340be2b_1247_4cb7_a464_71a80a7dac5b.slice/crio-4756e03eed3cb7a7a748cc66b4b0abd0cd781745e97df778dca5fe8c1f341c1f WatchSource:0}: Error finding container 4756e03eed3cb7a7a748cc66b4b0abd0cd781745e97df778dca5fe8c1f341c1f: Status 404 returned error can't find the container with id 4756e03eed3cb7a7a748cc66b4b0abd0cd781745e97df778dca5fe8c1f341c1f Jul 07 14:31:39.496703 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.496668 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:39.498122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.497141 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:39.498122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.497555 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:39.502205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.501914 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 07 14:31:39.502205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.501952 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 07 14:31:39.502205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.502011 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r5ldv\"" Jul 07 14:31:39.502205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.501929 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 07 14:31:39.502205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.502177 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 07 14:31:39.503719 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.502359 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pt9ld\"" Jul 07 14:31:39.764889 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:39.764780 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6sfrj" event={"ID":"d340be2b-1247-4cb7-a464-71a80a7dac5b","Type":"ContainerStarted","Data":"4756e03eed3cb7a7a748cc66b4b0abd0cd781745e97df778dca5fe8c1f341c1f"} Jul 07 14:31:44.062570 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.062533 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:44.062570 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.062573 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:44.065190 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.065159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/581936ef-d2cd-49ad-a3c1-53f962e87c81-metrics-certs\") pod \"network-metrics-daemon-gqsjh\" (UID: \"581936ef-d2cd-49ad-a3c1-53f962e87c81\") " pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:44.066311 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.066287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f46e0533-6a2b-44aa-aaaf-d95fe0a32be0-original-pull-secret\") pod \"global-pull-secret-syncer-kq895\" (UID: \"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0\") " pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:44.163324 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.163225 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:44.165766 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.165741 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m8vh\" (UniqueName: \"kubernetes.io/projected/12e5ead1-431e-4985-bf33-154606cc50da-kube-api-access-9m8vh\") pod \"network-check-target-45vm5\" (UID: \"12e5ead1-431e-4985-bf33-154606cc50da\") " pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:44.317134 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.317049 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:44.329447 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.329418 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kq895" Jul 07 14:31:44.335788 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.335762 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gqsjh" Jul 07 14:31:44.581149 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.581115 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gqsjh"] Jul 07 14:31:44.584691 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:44.584652 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod581936ef_d2cd_49ad_a3c1_53f962e87c81.slice/crio-af192312396081d346a25983772df46678f261e5a0a003311ec89e1921607e6d WatchSource:0}: Error finding container af192312396081d346a25983772df46678f261e5a0a003311ec89e1921607e6d: Status 404 returned error can't find the container with id af192312396081d346a25983772df46678f261e5a0a003311ec89e1921607e6d Jul 07 14:31:44.772452 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.772417 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kq895"] Jul 07 14:31:44.776876 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:44.776845 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf46e0533_6a2b_44aa_aaaf_d95fe0a32be0.slice/crio-202f7fcc21c4b686aeb989a5da1485789e39749057e7e0d46fe2514e5ee76ca3 WatchSource:0}: Error finding container 202f7fcc21c4b686aeb989a5da1485789e39749057e7e0d46fe2514e5ee76ca3: Status 404 returned error can't find the container with id 202f7fcc21c4b686aeb989a5da1485789e39749057e7e0d46fe2514e5ee76ca3 Jul 07 14:31:44.780059 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.780015 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-45vm5"] Jul 07 14:31:44.781668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.781641 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6sfrj" event={"ID":"d340be2b-1247-4cb7-a464-71a80a7dac5b","Type":"ContainerStarted","Data":"f4638c39518086d39b32505891555d50f54ce36bed0a7c965009703dcc1c3293"} Jul 07 14:31:44.783695 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.783667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w22js" event={"ID":"57562010-e684-4a89-8d5f-a8c536aa93b9","Type":"ContainerStarted","Data":"204488abb744d8ccac3386c2a5091db094030b26ace421e66094a0263d7ad8c0"} Jul 07 14:31:44.783790 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:44.783694 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e5ead1_431e_4985_bf33_154606cc50da.slice/crio-09457a360e625def9aae2aea1213709f4e67871d711ca1e8a04cf51d542d1271 WatchSource:0}: Error finding container 09457a360e625def9aae2aea1213709f4e67871d711ca1e8a04cf51d542d1271: Status 404 returned error can't find the container with id 09457a360e625def9aae2aea1213709f4e67871d711ca1e8a04cf51d542d1271 Jul 07 14:31:44.783790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.783717 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w22js" event={"ID":"57562010-e684-4a89-8d5f-a8c536aa93b9","Type":"ContainerStarted","Data":"a8c67729dac3a38c8da61296d1a245ff4066c58b5d9d6e728ddc61da7385b388"} Jul 07 14:31:44.783790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.783759 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w22js" Jul 07 14:31:44.784807 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.784783 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gqsjh" event={"ID":"581936ef-d2cd-49ad-a3c1-53f962e87c81","Type":"ContainerStarted","Data":"af192312396081d346a25983772df46678f261e5a0a003311ec89e1921607e6d"} Jul 07 14:31:44.786545 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.786526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7kqh" event={"ID":"03a7a5d3-cc26-4a79-af4a-915470b2a16e","Type":"ContainerStarted","Data":"0b43202e419c45e10fb7da7fd4479504f1c94f048b4dc826c1fe005fa66a6f0f"} Jul 07 14:31:44.786625 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.786574 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7kqh" event={"ID":"03a7a5d3-cc26-4a79-af4a-915470b2a16e","Type":"ContainerStarted","Data":"69f0987cf6a69ab0eaf2b8455aa2221853339be362e020b715f1e35d2fabd4fb"} Jul 07 14:31:44.808053 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.807993 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6sfrj" podStartSLOduration=1.770549927 podStartE2EDuration="6.807976457s" totalImagesPullingTime="5.03742653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:44.807708101 +0000 UTC m=+66.990454972" watchObservedRunningTime="2026-07-07 14:31:44.807976457 +0000 UTC m=+66.990723319" Jul 07 14:31:44.831336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:44.831272 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w22js" podStartSLOduration=1.6837624340000001 podStartE2EDuration="6.83124769s" totalImagesPullingTime="5.147485256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:44.829723661 +0000 UTC m=+67.012470532" watchObservedRunningTime="2026-07-07 14:31:44.83124769 +0000 UTC m=+67.013994558" Jul 07 14:31:45.795092 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:45.794951 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kq895" event={"ID":"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0","Type":"ContainerStarted","Data":"202f7fcc21c4b686aeb989a5da1485789e39749057e7e0d46fe2514e5ee76ca3"} Jul 07 14:31:45.797782 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:45.797362 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-45vm5" event={"ID":"12e5ead1-431e-4985-bf33-154606cc50da","Type":"ContainerStarted","Data":"09457a360e625def9aae2aea1213709f4e67871d711ca1e8a04cf51d542d1271"} Jul 07 14:31:46.803863 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:46.803815 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gqsjh" event={"ID":"581936ef-d2cd-49ad-a3c1-53f962e87c81","Type":"ContainerStarted","Data":"a71eb11467732a11969420cd1d19e72724c27c3a57eb1a3d651ff799f9735ad0"} Jul 07 14:31:46.804351 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:46.803885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gqsjh" event={"ID":"581936ef-d2cd-49ad-a3c1-53f962e87c81","Type":"ContainerStarted","Data":"37d57ea5febdac5e4fa77ac220b7c971291fb5043e2ac09cea63d05a55f3b88f"} Jul 07 14:31:46.857673 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:46.857610 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gqsjh" podStartSLOduration=67.42303504 podStartE2EDuration="1m8.857588558s" totalImagesPullingTime="1.434553518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:46.856816483 +0000 UTC m=+69.039563370" watchObservedRunningTime="2026-07-07 14:31:46.857588558 +0000 UTC m=+69.040335406" Jul 07 14:31:47.811729 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:47.811612 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d7kqh" event={"ID":"03a7a5d3-cc26-4a79-af4a-915470b2a16e","Type":"ContainerStarted","Data":"fd4da9c016a26badd781762def45609e2e675c3bb1cd4269cfcb89e81141efcf"} Jul 07 14:31:47.834489 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:47.834424 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d7kqh" podStartSLOduration=1.017411935 podStartE2EDuration="9.834401846s" totalImagesPullingTime="8.816989911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:31:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:47.833506331 +0000 UTC m=+70.016253201" watchObservedRunningTime="2026-07-07 14:31:47.834401846 +0000 UTC m=+70.017148717" Jul 07 14:31:50.823071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:50.823031 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kq895" event={"ID":"f46e0533-6a2b-44aa-aaaf-d95fe0a32be0","Type":"ContainerStarted","Data":"8e51682f757786f8429fe99bdedbdad910ed4b2254b21dec37a0e1a9f8894862"} Jul 07 14:31:50.824541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:50.824515 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-45vm5" event={"ID":"12e5ead1-431e-4985-bf33-154606cc50da","Type":"ContainerStarted","Data":"243d1c1dfe60ff2f993373f46a5b6f62d0a996aa6e6ae7f0eaa2aa88a854b476"} Jul 07 14:31:50.824646 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:50.824583 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:31:50.841249 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:50.841196 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kq895" podStartSLOduration=67.171802239 podStartE2EDuration="1m12.841182579s" totalImagesPullingTime="5.66938034s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:50.840829905 +0000 UTC m=+73.023576777" watchObservedRunningTime="2026-07-07 14:31:50.841182579 +0000 UTC m=+73.023929449" Jul 07 14:31:50.860551 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:50.860486 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-45vm5" podStartSLOduration=67.20051425 podStartE2EDuration="1m12.860467437s" totalImagesPullingTime="5.659953187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:30:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:50.86046121 +0000 UTC m=+73.043208083" watchObservedRunningTime="2026-07-07 14:31:50.860467437 +0000 UTC m=+73.043214326" Jul 07 14:31:54.799978 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:54.799923 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w22js" Jul 07 14:31:55.877738 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.877708 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx"] Jul 07 14:31:55.880092 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.880076 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.886276 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.886248 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 07 14:31:55.886276 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.886267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 07 14:31:55.886448 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.886267 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7mvb4\"" Jul 07 14:31:55.886762 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.886746 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 07 14:31:55.886971 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.886932 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 07 14:31:55.891151 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.891138 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 07 14:31:55.894053 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.894040 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 07 14:31:55.908727 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.908694 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx"] Jul 07 14:31:55.932484 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.932455 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-vcggb"] Jul 07 14:31:55.934783 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.934767 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:55.939127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.939100 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7sznj\"" Jul 07 14:31:55.939127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.939118 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 07 14:31:55.939346 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.939334 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 07 14:31:55.949908 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.949876 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.950071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.949919 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.950071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.949963 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.950071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.949998 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.950071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.950041 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.950230 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.950073 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58mb6\" (UniqueName: \"kubernetes.io/projected/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-api-access-58mb6\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:55.956783 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:55.956764 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 07 14:31:56.051325 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.051325 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051326 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051599 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051357 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-wtmp\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051599 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051385 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58mb6\" (UniqueName: \"kubernetes.io/projected/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-api-access-58mb6\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.051599 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051471 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.051599 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051564 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-root\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051599 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051586 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf9hr\" (UniqueName: \"kubernetes.io/projected/9393f8f8-e350-4d43-a744-0b7facbe8812-kube-api-access-xf9hr\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051621 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051655 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051707 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9393f8f8-e350-4d43-a744-0b7facbe8812-metrics-client-ca\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051743 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-sys\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051764 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-textfile\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:56.051766 2564 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051762 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051786 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.051845 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:31:56.051839 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-tls podName:5ad72fb6-1aed-4b62-bfca-808d20a84a0c nodeName:}" failed. No retries permitted until 2026-07-07 14:31:56.551816827 +0000 UTC m=+78.734563703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-tls") pod "kube-state-metrics-7c9dbb8b7d-tbxvx" (UID: "5ad72fb6-1aed-4b62-bfca-808d20a84a0c") : secret "kube-state-metrics-tls" not found Jul 07 14:31:56.052235 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.051923 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.052235 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.052001 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-tls\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.052302 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.052249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.052344 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.052326 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.054463 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.054434 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.067185 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.067159 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-58mb6\" (UniqueName: \"kubernetes.io/projected/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-api-access-58mb6\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.152390 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152303 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-wtmp\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152390 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152346 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-root\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152390 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152371 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf9hr\" (UniqueName: \"kubernetes.io/projected/9393f8f8-e350-4d43-a744-0b7facbe8812-kube-api-access-xf9hr\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152432 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-root\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-wtmp\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152535 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9393f8f8-e350-4d43-a744-0b7facbe8812-metrics-client-ca\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152571 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-sys\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152597 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-textfile\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.152674 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152625 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9393f8f8-e350-4d43-a744-0b7facbe8812-sys\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.153030 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-tls\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.153030 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.152715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.153133 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.153041 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-textfile\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.153174 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.153152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9393f8f8-e350-4d43-a744-0b7facbe8812-metrics-client-ca\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.153210 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.153175 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-accelerators-collector-config\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.155234 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.155216 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.155387 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.155368 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9393f8f8-e350-4d43-a744-0b7facbe8812-node-exporter-tls\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.163880 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.163857 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf9hr\" (UniqueName: \"kubernetes.io/projected/9393f8f8-e350-4d43-a744-0b7facbe8812-kube-api-access-xf9hr\") pod \"node-exporter-vcggb\" (UID: \"9393f8f8-e350-4d43-a744-0b7facbe8812\") " pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.243011 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.242964 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-vcggb" Jul 07 14:31:56.253447 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:56.253416 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9393f8f8_e350_4d43_a744_0b7facbe8812.slice/crio-ccc6628d675dc914496e3519c0ae04a1a9490dd093ba0c5b11bee9da44e0d3bd WatchSource:0}: Error finding container ccc6628d675dc914496e3519c0ae04a1a9490dd093ba0c5b11bee9da44e0d3bd: Status 404 returned error can't find the container with id ccc6628d675dc914496e3519c0ae04a1a9490dd093ba0c5b11bee9da44e0d3bd Jul 07 14:31:56.555533 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.555491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.557854 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.557820 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5ad72fb6-1aed-4b62-bfca-808d20a84a0c-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-tbxvx\" (UID: \"5ad72fb6-1aed-4b62-bfca-808d20a84a0c\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.788700 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.788642 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" Jul 07 14:31:56.845591 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.845546 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcggb" event={"ID":"9393f8f8-e350-4d43-a744-0b7facbe8812","Type":"ContainerStarted","Data":"ccc6628d675dc914496e3519c0ae04a1a9490dd093ba0c5b11bee9da44e0d3bd"} Jul 07 14:31:56.944525 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:56.944468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx"] Jul 07 14:31:56.948618 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:31:56.948587 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ad72fb6_1aed_4b62_bfca_808d20a84a0c.slice/crio-45e0ad60a06f59137cc939e961aca538ebc46ef45d4eaa4f93a03e3afb81d0c3 WatchSource:0}: Error finding container 45e0ad60a06f59137cc939e961aca538ebc46ef45d4eaa4f93a03e3afb81d0c3: Status 404 returned error can't find the container with id 45e0ad60a06f59137cc939e961aca538ebc46ef45d4eaa4f93a03e3afb81d0c3 Jul 07 14:31:57.850824 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:57.850784 2564 generic.go:356] "Generic (PLEG): container finished" podID="9393f8f8-e350-4d43-a744-0b7facbe8812" containerID="25a7f3d30c789c0887e66fed59fca0767969106a7eea8707851c0c9359028755" exitCode=0 Jul 07 14:31:57.851072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:57.850885 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcggb" event={"ID":"9393f8f8-e350-4d43-a744-0b7facbe8812","Type":"ContainerDied","Data":"25a7f3d30c789c0887e66fed59fca0767969106a7eea8707851c0c9359028755"} Jul 07 14:31:57.852539 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:57.852509 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" event={"ID":"5ad72fb6-1aed-4b62-bfca-808d20a84a0c","Type":"ContainerStarted","Data":"45e0ad60a06f59137cc939e961aca538ebc46ef45d4eaa4f93a03e3afb81d0c3"} Jul 07 14:31:58.862501 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.862446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" event={"ID":"5ad72fb6-1aed-4b62-bfca-808d20a84a0c","Type":"ContainerStarted","Data":"8d5f5cce8ce08a6bdb6a1938bcecde5663fa8541945b45f7a855fd9ed5ad711e"} Jul 07 14:31:58.862997 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.862558 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" event={"ID":"5ad72fb6-1aed-4b62-bfca-808d20a84a0c","Type":"ContainerStarted","Data":"2d94cd20d7ba7ba73f31d9a0342690c186668376c1e36dfea0656541ba251051"} Jul 07 14:31:58.862997 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.862580 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" event={"ID":"5ad72fb6-1aed-4b62-bfca-808d20a84a0c","Type":"ContainerStarted","Data":"12b9e97fbff7a457c95d6a3831237e1626f755c879a3544ca1b18aa4ea65eff6"} Jul 07 14:31:58.864645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.864618 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcggb" event={"ID":"9393f8f8-e350-4d43-a744-0b7facbe8812","Type":"ContainerStarted","Data":"7bb0e784497f9cdd5556782a3147efa8421040210ba539c66f83770cc460555d"} Jul 07 14:31:58.864760 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.864664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-vcggb" event={"ID":"9393f8f8-e350-4d43-a744-0b7facbe8812","Type":"ContainerStarted","Data":"3f532140bad219fbe1d1f1c1c87899c933e2273b785e4bd4e557204a456fd686"} Jul 07 14:31:58.893970 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.893894 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-tbxvx" podStartSLOduration=2.453144301 podStartE2EDuration="3.893877413s" totalImagesPullingTime="1.440733112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:58.892172185 +0000 UTC m=+81.074919056" watchObservedRunningTime="2026-07-07 14:31:58.893877413 +0000 UTC m=+81.076624282" Jul 07 14:31:58.918564 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:58.918505 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-vcggb" podStartSLOduration=2.84907124 podStartE2EDuration="3.918486043s" totalImagesPullingTime="1.003843799s" totalInitContainerRuntime="65.571004ms" isStatefulPod=true podCreationTimestamp="2026-07-07 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:31:58.917306369 +0000 UTC m=+81.100053250" watchObservedRunningTime="2026-07-07 14:31:58.918486043 +0000 UTC m=+81.101232913" Jul 07 14:31:59.769461 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:31:59.769351 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-54b78c87fb-cgkjh" Jul 07 14:32:00.299343 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.299304 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59"] Jul 07 14:32:00.301515 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.301499 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.303628 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.303605 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 07 14:32:00.303745 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.303656 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-9768g\"" Jul 07 14:32:00.312108 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.312086 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59"] Jul 07 14:32:00.338824 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.338794 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-775d49d886-tw28k"] Jul 07 14:32:00.341134 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.341113 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.343790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.343763 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 07 14:32:00.343918 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.343895 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-cw9hx\"" Jul 07 14:32:00.343918 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.343904 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 07 14:32:00.343918 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.343913 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-e3al0dbuusdmc\"" Jul 07 14:32:00.344100 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.343900 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 07 14:32:00.344205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.344191 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 07 14:32:00.353964 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.353921 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-775d49d886-tw28k"] Jul 07 14:32:00.384477 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-secret-metrics-server-client-certs\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.384642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbwmj\" (UniqueName: \"kubernetes.io/projected/b1264afe-bb3a-4f62-8926-13cc45561329-kube-api-access-hbwmj\") pod \"monitoring-plugin-d5dcff7cf-47v59\" (UID: \"b1264afe-bb3a-4f62-8926-13cc45561329\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.384642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-client-ca-bundle\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.384642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384566 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e733038b-42cf-449d-b034-0eef84ce92e0-metrics-server-audit-profiles\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.384642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1264afe-bb3a-4f62-8926-13cc45561329-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-47v59\" (UID: \"b1264afe-bb3a-4f62-8926-13cc45561329\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.384642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384639 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h52jg\" (UniqueName: \"kubernetes.io/projected/e733038b-42cf-449d-b034-0eef84ce92e0-kube-api-access-h52jg\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.384827 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384656 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e733038b-42cf-449d-b034-0eef84ce92e0-audit-log\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.384827 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e733038b-42cf-449d-b034-0eef84ce92e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.384827 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.384720 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-secret-metrics-server-tls\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485391 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485353 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbwmj\" (UniqueName: \"kubernetes.io/projected/b1264afe-bb3a-4f62-8926-13cc45561329-kube-api-access-hbwmj\") pod \"monitoring-plugin-d5dcff7cf-47v59\" (UID: \"b1264afe-bb3a-4f62-8926-13cc45561329\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.485391 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485391 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-client-ca-bundle\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485415 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e733038b-42cf-449d-b034-0eef84ce92e0-metrics-server-audit-profiles\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485439 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1264afe-bb3a-4f62-8926-13cc45561329-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-47v59\" (UID: \"b1264afe-bb3a-4f62-8926-13cc45561329\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485470 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h52jg\" (UniqueName: \"kubernetes.io/projected/e733038b-42cf-449d-b034-0eef84ce92e0-kube-api-access-h52jg\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485497 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e733038b-42cf-449d-b034-0eef84ce92e0-audit-log\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485532 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e733038b-42cf-449d-b034-0eef84ce92e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485559 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-secret-metrics-server-tls\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.485653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.485583 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-secret-metrics-server-client-certs\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.486085 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.486066 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e733038b-42cf-449d-b034-0eef84ce92e0-audit-log\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.486432 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.486405 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e733038b-42cf-449d-b034-0eef84ce92e0-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.486706 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.486678 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e733038b-42cf-449d-b034-0eef84ce92e0-metrics-server-audit-profiles\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.488142 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.488113 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-client-ca-bundle\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.488208 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.488170 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b1264afe-bb3a-4f62-8926-13cc45561329-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-47v59\" (UID: \"b1264afe-bb3a-4f62-8926-13cc45561329\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.488256 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.488227 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-secret-metrics-server-client-certs\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.488288 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.488252 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e733038b-42cf-449d-b034-0eef84ce92e0-secret-metrics-server-tls\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.494170 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.494152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbwmj\" (UniqueName: \"kubernetes.io/projected/b1264afe-bb3a-4f62-8926-13cc45561329-kube-api-access-hbwmj\") pod \"monitoring-plugin-d5dcff7cf-47v59\" (UID: \"b1264afe-bb3a-4f62-8926-13cc45561329\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.494812 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.494791 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h52jg\" (UniqueName: \"kubernetes.io/projected/e733038b-42cf-449d-b034-0eef84ce92e0-kube-api-access-h52jg\") pod \"metrics-server-775d49d886-tw28k\" (UID: \"e733038b-42cf-449d-b034-0eef84ce92e0\") " pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.610910 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.610822 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:00.650857 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.650821 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:00.744676 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.744648 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59"] Jul 07 14:32:00.746984 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:32:00.746954 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1264afe_bb3a_4f62_8926_13cc45561329.slice/crio-3923459d3d99eb4d1166b9a029faedf1b42177fb3c7d7a083e3871c55d0b4838 WatchSource:0}: Error finding container 3923459d3d99eb4d1166b9a029faedf1b42177fb3c7d7a083e3871c55d0b4838: Status 404 returned error can't find the container with id 3923459d3d99eb4d1166b9a029faedf1b42177fb3c7d7a083e3871c55d0b4838 Jul 07 14:32:00.793067 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.793034 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-775d49d886-tw28k"] Jul 07 14:32:00.795987 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:32:00.795963 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode733038b_42cf_449d_b034_0eef84ce92e0.slice/crio-8e86283a0bb3935779689acfbcb521d762ca697f6f2744235a489bdd29333d38 WatchSource:0}: Error finding container 8e86283a0bb3935779689acfbcb521d762ca697f6f2744235a489bdd29333d38: Status 404 returned error can't find the container with id 8e86283a0bb3935779689acfbcb521d762ca697f6f2744235a489bdd29333d38 Jul 07 14:32:00.872581 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.872480 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" event={"ID":"b1264afe-bb3a-4f62-8926-13cc45561329","Type":"ContainerStarted","Data":"3923459d3d99eb4d1166b9a029faedf1b42177fb3c7d7a083e3871c55d0b4838"} Jul 07 14:32:00.873575 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:00.873550 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" event={"ID":"e733038b-42cf-449d-b034-0eef84ce92e0","Type":"ContainerStarted","Data":"8e86283a0bb3935779689acfbcb521d762ca697f6f2744235a489bdd29333d38"} Jul 07 14:32:01.474181 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.474146 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cf4545bb5-s2tm9"] Jul 07 14:32:01.476504 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.476474 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.480341 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.480286 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 07 14:32:01.480341 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.480305 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 07 14:32:01.480581 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.480347 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-sd4hz\"" Jul 07 14:32:01.480581 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.480313 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 07 14:32:01.480581 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.480470 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 07 14:32:01.482969 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.481636 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 07 14:32:01.482969 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.482002 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 07 14:32:01.487483 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.487085 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 07 14:32:01.490294 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.490271 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf4545bb5-s2tm9"] Jul 07 14:32:01.491413 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.491391 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 07 14:32:01.594310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594270 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-config\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.594565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594327 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-serving-cert\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.594565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594398 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-oauth-serving-cert\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.594565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594428 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-service-ca\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.594565 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594529 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-oauth-config\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.594815 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594570 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wnmk\" (UniqueName: \"kubernetes.io/projected/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-kube-api-access-6wnmk\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.594815 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.594637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-trusted-ca-bundle\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.695905 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.695862 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-serving-cert\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.695905 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.695911 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-oauth-serving-cert\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696182 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.695962 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-service-ca\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696182 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696008 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-oauth-config\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696182 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696031 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wnmk\" (UniqueName: \"kubernetes.io/projected/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-kube-api-access-6wnmk\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696182 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696066 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-trusted-ca-bundle\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696182 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696111 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-config\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696796 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696763 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-oauth-serving-cert\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696923 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696826 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-service-ca\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.696923 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.696834 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-config\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.697076 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.697053 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-trusted-ca-bundle\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.698404 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.698382 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-serving-cert\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.698487 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.698435 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-oauth-config\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.704086 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.704064 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wnmk\" (UniqueName: \"kubernetes.io/projected/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-kube-api-access-6wnmk\") pod \"console-7cf4545bb5-s2tm9\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:01.799998 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:01.799895 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:02.264072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:02.264033 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cf4545bb5-s2tm9"] Jul 07 14:32:02.267278 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:32:02.267247 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa4a021_ac21_45ef_b3ab_4ede6c595b04.slice/crio-5bce8b23a826891d114f81efcc631484d381558c4edbdb2d173f7fb94c8533c4 WatchSource:0}: Error finding container 5bce8b23a826891d114f81efcc631484d381558c4edbdb2d173f7fb94c8533c4: Status 404 returned error can't find the container with id 5bce8b23a826891d114f81efcc631484d381558c4edbdb2d173f7fb94c8533c4 Jul 07 14:32:02.883654 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:02.883598 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" event={"ID":"b1264afe-bb3a-4f62-8926-13cc45561329","Type":"ContainerStarted","Data":"cb8bc0fd9f3ac47d49e6ffc1d1c82f1e3d5481c1540e47192a803c1f6d6af88c"} Jul 07 14:32:02.884172 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:02.884035 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:02.885401 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:02.885360 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf4545bb5-s2tm9" event={"ID":"4aa4a021-ac21-45ef-b3ab-4ede6c595b04","Type":"ContainerStarted","Data":"5bce8b23a826891d114f81efcc631484d381558c4edbdb2d173f7fb94c8533c4"} Jul 07 14:32:02.889750 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:02.889722 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" Jul 07 14:32:02.902816 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:02.902574 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-47v59" podStartSLOduration=1.486906044 podStartE2EDuration="2.902546749s" totalImagesPullingTime="1.415640705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:02.901346037 +0000 UTC m=+85.084092912" watchObservedRunningTime="2026-07-07 14:32:02.902546749 +0000 UTC m=+85.085293713" Jul 07 14:32:03.891563 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:03.891526 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" event={"ID":"e733038b-42cf-449d-b034-0eef84ce92e0","Type":"ContainerStarted","Data":"05c79991fbc0544ec8b5873ff306b923544e41199660b9669b036ff01277d7eb"} Jul 07 14:32:03.913444 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:03.913383 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" podStartSLOduration=1.413245836 podStartE2EDuration="3.913366537s" totalImagesPullingTime="2.500120701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:03.911294162 +0000 UTC m=+86.094041047" watchObservedRunningTime="2026-07-07 14:32:03.913366537 +0000 UTC m=+86.096113408" Jul 07 14:32:05.901083 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:05.901042 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf4545bb5-s2tm9" event={"ID":"4aa4a021-ac21-45ef-b3ab-4ede6c595b04","Type":"ContainerStarted","Data":"acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f"} Jul 07 14:32:05.927283 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:05.927227 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cf4545bb5-s2tm9" podStartSLOduration=2.129499534 podStartE2EDuration="4.927211825s" totalImagesPullingTime="2.797712291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:32:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:32:05.92597157 +0000 UTC m=+88.108718438" watchObservedRunningTime="2026-07-07 14:32:05.927211825 +0000 UTC m=+88.109958695" Jul 07 14:32:11.800033 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:11.799988 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:11.800417 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:11.800061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:11.805056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:11.805031 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:11.924964 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:11.924921 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:32:20.651790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:20.651752 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:20.652293 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:20.651828 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:21.830370 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:21.830339 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-45vm5" Jul 07 14:32:40.656583 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:40.656553 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:32:40.660292 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:32:40.660269 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-775d49d886-tw28k" Jul 07 14:33:20.022365 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.022332 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2"] Jul 07 14:33:20.024679 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.024664 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.029011 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.028988 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-264x5\"" Jul 07 14:33:20.029492 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.029475 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 07 14:33:20.029611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.029578 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 07 14:33:20.029682 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.029617 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 07 14:33:20.030580 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.030565 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 07 14:33:20.032672 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.032653 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 07 14:33:20.040906 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.040885 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 07 14:33:20.049010 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.048980 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2"] Jul 07 14:33:20.099232 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099188 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-serving-certs-ca-bundle\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099232 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099233 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-metrics-client-ca\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099445 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099263 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099445 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-telemeter-client-tls\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099445 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099359 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-federate-client-tls\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099445 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099377 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqjwd\" (UniqueName: \"kubernetes.io/projected/6b4f846f-91d6-46fc-8d0f-b098f5190242-kube-api-access-wqjwd\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099445 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099403 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.099599 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.099469 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-secret-telemeter-client\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200054 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200012 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-serving-certs-ca-bundle\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200054 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-metrics-client-ca\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200313 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200313 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200207 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-telemeter-client-tls\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200313 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-federate-client-tls\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200313 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200256 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqjwd\" (UniqueName: \"kubernetes.io/projected/6b4f846f-91d6-46fc-8d0f-b098f5190242-kube-api-access-wqjwd\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200313 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200295 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200561 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200350 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-secret-telemeter-client\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.200916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200883 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-serving-certs-ca-bundle\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.201071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.200923 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-metrics-client-ca\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.201273 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.201250 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6b4f846f-91d6-46fc-8d0f-b098f5190242-telemeter-trusted-ca-bundle\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.202644 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.202624 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.202911 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.202892 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-federate-client-tls\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.203107 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.203092 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-secret-telemeter-client\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.203270 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.203249 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/6b4f846f-91d6-46fc-8d0f-b098f5190242-telemeter-client-tls\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.211084 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.211058 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqjwd\" (UniqueName: \"kubernetes.io/projected/6b4f846f-91d6-46fc-8d0f-b098f5190242-kube-api-access-wqjwd\") pod \"telemeter-client-77d84d4d8d-rpsb2\" (UID: \"6b4f846f-91d6-46fc-8d0f-b098f5190242\") " pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.334500 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.334404 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" Jul 07 14:33:20.471293 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:20.471262 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2"] Jul 07 14:33:20.474256 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:33:20.474231 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b4f846f_91d6_46fc_8d0f_b098f5190242.slice/crio-a055d3459d316e01261d09c08764e0474ebec59d9ed69f0583197d1a5d80d23d WatchSource:0}: Error finding container a055d3459d316e01261d09c08764e0474ebec59d9ed69f0583197d1a5d80d23d: Status 404 returned error can't find the container with id a055d3459d316e01261d09c08764e0474ebec59d9ed69f0583197d1a5d80d23d Jul 07 14:33:21.163811 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:21.163774 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" event={"ID":"6b4f846f-91d6-46fc-8d0f-b098f5190242","Type":"ContainerStarted","Data":"a055d3459d316e01261d09c08764e0474ebec59d9ed69f0583197d1a5d80d23d"} Jul 07 14:33:23.173498 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:23.173459 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" event={"ID":"6b4f846f-91d6-46fc-8d0f-b098f5190242","Type":"ContainerStarted","Data":"3a37a88189030ccb8490ca52a9810b37b2908b2f0742fad06fad342b69eed4f6"} Jul 07 14:33:24.179359 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:24.179318 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" event={"ID":"6b4f846f-91d6-46fc-8d0f-b098f5190242","Type":"ContainerStarted","Data":"fef12f85d941a2684b7713b5fb4a1d4b309b50364fe177e4f0e09954b49ae735"} Jul 07 14:33:24.179811 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:24.179376 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" event={"ID":"6b4f846f-91d6-46fc-8d0f-b098f5190242","Type":"ContainerStarted","Data":"7e9b742c464a7e845b56ac5ffd73978befd502a9d5bbec7ce88383cdd622e153"} Jul 07 14:33:24.202342 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:24.202252 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-77d84d4d8d-rpsb2" podStartSLOduration=2.24443716 podStartE2EDuration="5.202230347s" totalImagesPullingTime="2.957793187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:19 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:24.200779716 +0000 UTC m=+166.383526627" watchObservedRunningTime="2026-07-07 14:33:24.202230347 +0000 UTC m=+166.384977217" Jul 07 14:33:24.985101 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:24.985062 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b74c74bf8-kwxjx"] Jul 07 14:33:24.987236 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:24.987214 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.000558 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.000530 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b74c74bf8-kwxjx"] Jul 07 14:33:25.144452 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144406 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-serving-cert\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.144452 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144451 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk8dz\" (UniqueName: \"kubernetes.io/projected/d0fc4b33-d45f-4188-9999-e39a8da25a50-kube-api-access-fk8dz\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.144668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144475 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-trusted-ca-bundle\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.144668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144536 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-config\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.144668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-service-ca\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.144668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144605 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-oauth-config\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.144820 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.144662 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-oauth-serving-cert\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.245815 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245715 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-serving-cert\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.245815 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245774 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk8dz\" (UniqueName: \"kubernetes.io/projected/d0fc4b33-d45f-4188-9999-e39a8da25a50-kube-api-access-fk8dz\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.245815 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245810 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-trusted-ca-bundle\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246404 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245829 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-config\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246404 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245850 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-service-ca\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246404 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-oauth-config\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246404 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.245927 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-oauth-serving-cert\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246687 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.246657 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-service-ca\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246746 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.246677 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-config\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.246846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.246823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-oauth-serving-cert\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.247000 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.246983 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-trusted-ca-bundle\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.248494 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.248474 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-serving-cert\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.248607 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.248586 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-oauth-config\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.256070 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.256044 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk8dz\" (UniqueName: \"kubernetes.io/projected/d0fc4b33-d45f-4188-9999-e39a8da25a50-kube-api-access-fk8dz\") pod \"console-b74c74bf8-kwxjx\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.295998 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.295958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:25.435566 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:25.435497 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b74c74bf8-kwxjx"] Jul 07 14:33:25.440202 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:33:25.438218 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0fc4b33_d45f_4188_9999_e39a8da25a50.slice/crio-d5797ec8af5be3a422dfaf4896a07085549f4e0784a0c0cc41e3a6918218a56a WatchSource:0}: Error finding container d5797ec8af5be3a422dfaf4896a07085549f4e0784a0c0cc41e3a6918218a56a: Status 404 returned error can't find the container with id d5797ec8af5be3a422dfaf4896a07085549f4e0784a0c0cc41e3a6918218a56a Jul 07 14:33:26.187881 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:26.187845 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74c74bf8-kwxjx" event={"ID":"d0fc4b33-d45f-4188-9999-e39a8da25a50","Type":"ContainerStarted","Data":"fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee"} Jul 07 14:33:26.188046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:26.187895 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74c74bf8-kwxjx" event={"ID":"d0fc4b33-d45f-4188-9999-e39a8da25a50","Type":"ContainerStarted","Data":"d5797ec8af5be3a422dfaf4896a07085549f4e0784a0c0cc41e3a6918218a56a"} Jul 07 14:33:26.208132 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:26.208078 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b74c74bf8-kwxjx" podStartSLOduration=2.20806025 podStartE2EDuration="2.20806025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:33:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:33:26.206364221 +0000 UTC m=+168.389111124" watchObservedRunningTime="2026-07-07 14:33:26.20806025 +0000 UTC m=+168.390807129" Jul 07 14:33:35.296913 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:35.296811 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:35.296913 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:35.296883 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:35.301582 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:35.301558 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:36.227199 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:36.227162 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:33:36.275435 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:33:36.275403 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cf4545bb5-s2tm9"] Jul 07 14:34:01.305241 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.305179 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7cf4545bb5-s2tm9" podUID="4aa4a021-ac21-45ef-b3ab-4ede6c595b04" containerName="console" containerID="cri-o://acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f" gracePeriod=15 Jul 07 14:34:01.558300 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.558233 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:34:01.631526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631485 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-service-ca\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.631720 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631537 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-oauth-config\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.631720 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631567 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-oauth-serving-cert\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.631720 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631591 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wnmk\" (UniqueName: \"kubernetes.io/projected/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-kube-api-access-6wnmk\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.631720 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631634 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-trusted-ca-bundle\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.631720 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631658 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-serving-cert\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.631988 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.631777 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-config\") pod \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\" (UID: \"4aa4a021-ac21-45ef-b3ab-4ede6c595b04\") " Jul 07 14:34:01.632060 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.632036 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-service-ca" (OuterVolumeSpecName: "service-ca") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:34:01.632179 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.632115 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:34:01.632257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.632231 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-config" (OuterVolumeSpecName: "console-config") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:34:01.632336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.632315 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:34:01.633913 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.633887 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:34:01.634296 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.634277 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:34:01.634375 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.634289 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-kube-api-access-6wnmk" (OuterVolumeSpecName: "kube-api-access-6wnmk") pod "4aa4a021-ac21-45ef-b3ab-4ede6c595b04" (UID: "4aa4a021-ac21-45ef-b3ab-4ede6c595b04"). InnerVolumeSpecName "kube-api-access-6wnmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:34:01.732558 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732524 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-service-ca\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:01.732558 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732551 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-oauth-config\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:01.732558 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732562 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-oauth-serving-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:01.732558 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732571 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wnmk\" (UniqueName: \"kubernetes.io/projected/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-kube-api-access-6wnmk\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:01.732812 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732580 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-trusted-ca-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:01.732812 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732589 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-serving-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:01.732812 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:01.732597 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4aa4a021-ac21-45ef-b3ab-4ede6c595b04-console-config\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:34:02.310706 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.310674 2564 generic.go:356] "Generic (PLEG): container finished" podID="4aa4a021-ac21-45ef-b3ab-4ede6c595b04" containerID="acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f" exitCode=0 Jul 07 14:34:02.311140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.310719 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cf4545bb5-s2tm9" Jul 07 14:34:02.311140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.310781 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf4545bb5-s2tm9" event={"ID":"4aa4a021-ac21-45ef-b3ab-4ede6c595b04","Type":"ContainerDied","Data":"acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f"} Jul 07 14:34:02.311140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.310842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cf4545bb5-s2tm9" event={"ID":"4aa4a021-ac21-45ef-b3ab-4ede6c595b04","Type":"ContainerDied","Data":"5bce8b23a826891d114f81efcc631484d381558c4edbdb2d173f7fb94c8533c4"} Jul 07 14:34:02.311140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.310864 2564 scope.go:117] "RemoveContainer" containerID="acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f" Jul 07 14:34:02.319572 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.319550 2564 scope.go:117] "RemoveContainer" containerID="acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f" Jul 07 14:34:02.319904 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:34:02.319884 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f\": container with ID starting with acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f not found: ID does not exist" containerID="acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f" Jul 07 14:34:02.320004 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.319914 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f"} err="failed to get container status \"acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f\": rpc error: code = NotFound desc = could not find container \"acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f\": container with ID starting with acdfb69092f723477882f9b9eb140c7221cc94d7bc11d515446ca0bbef849a6f not found: ID does not exist" Jul 07 14:34:02.331725 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.331693 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cf4545bb5-s2tm9"] Jul 07 14:34:02.341049 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.341023 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cf4545bb5-s2tm9"] Jul 07 14:34:02.500468 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:02.500429 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa4a021-ac21-45ef-b3ab-4ede6c595b04" path="/var/lib/kubelet/pods/4aa4a021-ac21-45ef-b3ab-4ede6c595b04/volumes" Jul 07 14:34:55.200161 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.200128 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7fdd98b4d6-bf8sp"] Jul 07 14:34:55.200610 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.200399 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa4a021-ac21-45ef-b3ab-4ede6c595b04" containerName="console" Jul 07 14:34:55.200610 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.200412 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa4a021-ac21-45ef-b3ab-4ede6c595b04" containerName="console" Jul 07 14:34:55.200610 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.200462 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aa4a021-ac21-45ef-b3ab-4ede6c595b04" containerName="console" Jul 07 14:34:55.203412 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.203393 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.214769 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.214746 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fdd98b4d6-bf8sp"] Jul 07 14:34:55.338336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338297 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-service-ca\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.338336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338335 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-serving-cert\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.338554 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338360 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-console-config\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.338554 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338476 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-trusted-ca-bundle\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.338554 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338503 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-oauth-serving-cert\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.338554 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338525 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bv25\" (UniqueName: \"kubernetes.io/projected/717cc4cb-0796-468d-9833-440e139fb958-kube-api-access-7bv25\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.338554 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.338550 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-oauth-config\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.439626 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439590 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-trusted-ca-bundle\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.439626 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-oauth-serving-cert\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.439794 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439645 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bv25\" (UniqueName: \"kubernetes.io/projected/717cc4cb-0796-468d-9833-440e139fb958-kube-api-access-7bv25\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.439835 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439783 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-oauth-config\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.439904 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439888 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-service-ca\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.439971 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439917 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-serving-cert\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.440038 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.439973 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-console-config\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.440420 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.440394 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-oauth-serving-cert\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.440590 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.440563 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-service-ca\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.440704 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.440610 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-trusted-ca-bundle\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.440704 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.440667 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-console-config\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.442303 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.442281 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-serving-cert\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.442386 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.442340 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-oauth-config\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.447768 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.447744 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bv25\" (UniqueName: \"kubernetes.io/projected/717cc4cb-0796-468d-9833-440e139fb958-kube-api-access-7bv25\") pod \"console-7fdd98b4d6-bf8sp\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.512066 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.512028 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:34:55.643199 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:55.643165 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7fdd98b4d6-bf8sp"] Jul 07 14:34:55.646816 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:34:55.646785 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod717cc4cb_0796_468d_9833_440e139fb958.slice/crio-7649005a3ec65771b690c51edf9e3e69e32026e64ffaec2b74cd4740254c67e5 WatchSource:0}: Error finding container 7649005a3ec65771b690c51edf9e3e69e32026e64ffaec2b74cd4740254c67e5: Status 404 returned error can't find the container with id 7649005a3ec65771b690c51edf9e3e69e32026e64ffaec2b74cd4740254c67e5 Jul 07 14:34:56.488642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:56.488609 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdd98b4d6-bf8sp" event={"ID":"717cc4cb-0796-468d-9833-440e139fb958","Type":"ContainerStarted","Data":"76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471"} Jul 07 14:34:56.489078 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:56.488664 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdd98b4d6-bf8sp" event={"ID":"717cc4cb-0796-468d-9833-440e139fb958","Type":"ContainerStarted","Data":"7649005a3ec65771b690c51edf9e3e69e32026e64ffaec2b74cd4740254c67e5"} Jul 07 14:34:56.506853 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:34:56.506778 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7fdd98b4d6-bf8sp" podStartSLOduration=1.5067588349999999 podStartE2EDuration="1.506758835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:34:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:34:56.506511214 +0000 UTC m=+258.689258085" watchObservedRunningTime="2026-07-07 14:34:56.506758835 +0000 UTC m=+258.689505705" Jul 07 14:35:05.513002 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:05.512889 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:35:05.513002 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:05.512972 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:35:05.517773 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:05.517748 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:35:05.522846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:05.522820 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:35:05.603370 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:05.603336 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b74c74bf8-kwxjx"] Jul 07 14:35:30.624179 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.624137 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b74c74bf8-kwxjx" podUID="d0fc4b33-d45f-4188-9999-e39a8da25a50" containerName="console" containerID="cri-o://fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee" gracePeriod=15 Jul 07 14:35:30.867073 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.867048 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:35:30.910668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910570 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-oauth-serving-cert\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.910668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910632 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-trusted-ca-bundle\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.910898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910673 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-serving-cert\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.910898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910702 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-config\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.910898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910721 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-service-ca\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.910898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910777 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-oauth-config\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.910898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.910810 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fk8dz\" (UniqueName: \"kubernetes.io/projected/d0fc4b33-d45f-4188-9999-e39a8da25a50-kube-api-access-fk8dz\") pod \"d0fc4b33-d45f-4188-9999-e39a8da25a50\" (UID: \"d0fc4b33-d45f-4188-9999-e39a8da25a50\") " Jul 07 14:35:30.911172 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.911121 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:35:30.911172 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.911156 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-config" (OuterVolumeSpecName: "console-config") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:35:30.911281 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.911168 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:35:30.911391 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.911366 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-service-ca" (OuterVolumeSpecName: "service-ca") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:35:30.912972 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.912914 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:35:30.913075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.912985 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:35:30.913075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:30.912996 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0fc4b33-d45f-4188-9999-e39a8da25a50-kube-api-access-fk8dz" (OuterVolumeSpecName: "kube-api-access-fk8dz") pod "d0fc4b33-d45f-4188-9999-e39a8da25a50" (UID: "d0fc4b33-d45f-4188-9999-e39a8da25a50"). InnerVolumeSpecName "kube-api-access-fk8dz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:35:31.011696 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011654 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-config\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.011696 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011684 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-service-ca\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.011696 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011693 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-oauth-config\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.011696 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011702 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fk8dz\" (UniqueName: \"kubernetes.io/projected/d0fc4b33-d45f-4188-9999-e39a8da25a50-kube-api-access-fk8dz\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.011982 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011714 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-oauth-serving-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.011982 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011724 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0fc4b33-d45f-4188-9999-e39a8da25a50-trusted-ca-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.011982 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.011733 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d0fc4b33-d45f-4188-9999-e39a8da25a50-console-serving-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:31.247279 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.247248 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg"] Jul 07 14:35:31.247505 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.247494 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0fc4b33-d45f-4188-9999-e39a8da25a50" containerName="console" Jul 07 14:35:31.247547 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.247506 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0fc4b33-d45f-4188-9999-e39a8da25a50" containerName="console" Jul 07 14:35:31.247580 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.247553 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0fc4b33-d45f-4188-9999-e39a8da25a50" containerName="console" Jul 07 14:35:31.249760 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.249745 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.256563 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.256543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:35:31.256663 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.256543 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:35:31.256663 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.256549 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bdvz2\"" Jul 07 14:35:31.274780 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.274749 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg"] Jul 07 14:35:31.314864 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.314812 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.314864 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.314867 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8k6lt\" (UniqueName: \"kubernetes.io/projected/c0cd405f-f34a-46b9-a27b-d904316934cf-kube-api-access-8k6lt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.315116 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.314981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.415649 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.415612 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.415740 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.415680 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.415740 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.415711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8k6lt\" (UniqueName: \"kubernetes.io/projected/c0cd405f-f34a-46b9-a27b-d904316934cf-kube-api-access-8k6lt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.416031 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.416010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.416099 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.416081 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.425234 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.425204 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8k6lt\" (UniqueName: \"kubernetes.io/projected/c0cd405f-f34a-46b9-a27b-d904316934cf-kube-api-access-8k6lt\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.558867 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.558774 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:31.616611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.616432 2564 generic.go:356] "Generic (PLEG): container finished" podID="d0fc4b33-d45f-4188-9999-e39a8da25a50" containerID="fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee" exitCode=0 Jul 07 14:35:31.616611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.616500 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74c74bf8-kwxjx" event={"ID":"d0fc4b33-d45f-4188-9999-e39a8da25a50","Type":"ContainerDied","Data":"fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee"} Jul 07 14:35:31.616611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.616563 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b74c74bf8-kwxjx" event={"ID":"d0fc4b33-d45f-4188-9999-e39a8da25a50","Type":"ContainerDied","Data":"d5797ec8af5be3a422dfaf4896a07085549f4e0784a0c0cc41e3a6918218a56a"} Jul 07 14:35:31.616611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.616504 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b74c74bf8-kwxjx" Jul 07 14:35:31.616880 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.616593 2564 scope.go:117] "RemoveContainer" containerID="fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee" Jul 07 14:35:31.627175 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.627069 2564 scope.go:117] "RemoveContainer" containerID="fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee" Jul 07 14:35:31.627459 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:35:31.627441 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee\": container with ID starting with fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee not found: ID does not exist" containerID="fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee" Jul 07 14:35:31.627499 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.627471 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee"} err="failed to get container status \"fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee\": rpc error: code = NotFound desc = could not find container \"fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee\": container with ID starting with fbd984a0ac9b5877ceb6f79a6004cefb7ad2a32cf88816ff0b350a3db163ecee not found: ID does not exist" Jul 07 14:35:31.639661 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.639626 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b74c74bf8-kwxjx"] Jul 07 14:35:31.643223 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.643195 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b74c74bf8-kwxjx"] Jul 07 14:35:31.694914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:31.694882 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg"] Jul 07 14:35:31.697808 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:35:31.697780 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cd405f_f34a_46b9_a27b_d904316934cf.slice/crio-da362fe9b177664ccdc03ba20da5750c33e576dc6e02fe5702f00abd6b97d60e WatchSource:0}: Error finding container da362fe9b177664ccdc03ba20da5750c33e576dc6e02fe5702f00abd6b97d60e: Status 404 returned error can't find the container with id da362fe9b177664ccdc03ba20da5750c33e576dc6e02fe5702f00abd6b97d60e Jul 07 14:35:32.502755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:32.502718 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0fc4b33-d45f-4188-9999-e39a8da25a50" path="/var/lib/kubelet/pods/d0fc4b33-d45f-4188-9999-e39a8da25a50/volumes" Jul 07 14:35:32.623849 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:32.623809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" event={"ID":"c0cd405f-f34a-46b9-a27b-d904316934cf","Type":"ContainerStarted","Data":"da362fe9b177664ccdc03ba20da5750c33e576dc6e02fe5702f00abd6b97d60e"} Jul 07 14:35:38.265294 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:38.265262 2564 kubelet.go:1648] "Image garbage collection succeeded" Jul 07 14:35:38.646712 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:38.646671 2564 generic.go:356] "Generic (PLEG): container finished" podID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerID="28c2c2374135cf3c4534c8fbff7bf4182cf51702d21be636c5b989c940acdc32" exitCode=0 Jul 07 14:35:38.646712 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:38.646714 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" event={"ID":"c0cd405f-f34a-46b9-a27b-d904316934cf","Type":"ContainerDied","Data":"28c2c2374135cf3c4534c8fbff7bf4182cf51702d21be636c5b989c940acdc32"} Jul 07 14:35:41.660700 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:41.660606 2564 generic.go:356] "Generic (PLEG): container finished" podID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerID="6781a83109347d8594d463e23438626744ae73332db3d36b4a093f467c0dd36e" exitCode=0 Jul 07 14:35:41.660700 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:41.660675 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" event={"ID":"c0cd405f-f34a-46b9-a27b-d904316934cf","Type":"ContainerDied","Data":"6781a83109347d8594d463e23438626744ae73332db3d36b4a093f467c0dd36e"} Jul 07 14:35:41.661685 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:41.661669 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:35:49.693481 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:49.693447 2564 generic.go:356] "Generic (PLEG): container finished" podID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerID="b490f1f8332beeebb6fecd2c43051fe651f5831a10ef92f55532636265bdd38c" exitCode=0 Jul 07 14:35:49.693871 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:49.693512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" event={"ID":"c0cd405f-f34a-46b9-a27b-d904316934cf","Type":"ContainerDied","Data":"b490f1f8332beeebb6fecd2c43051fe651f5831a10ef92f55532636265bdd38c"} Jul 07 14:35:50.825918 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.825885 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:50.986373 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.986332 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8k6lt\" (UniqueName: \"kubernetes.io/projected/c0cd405f-f34a-46b9-a27b-d904316934cf-kube-api-access-8k6lt\") pod \"c0cd405f-f34a-46b9-a27b-d904316934cf\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " Jul 07 14:35:50.986582 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.986432 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-bundle\") pod \"c0cd405f-f34a-46b9-a27b-d904316934cf\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " Jul 07 14:35:50.986582 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.986453 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-util\") pod \"c0cd405f-f34a-46b9-a27b-d904316934cf\" (UID: \"c0cd405f-f34a-46b9-a27b-d904316934cf\") " Jul 07 14:35:50.987140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.987117 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-bundle" (OuterVolumeSpecName: "bundle") pod "c0cd405f-f34a-46b9-a27b-d904316934cf" (UID: "c0cd405f-f34a-46b9-a27b-d904316934cf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:35:50.988636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.988611 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cd405f-f34a-46b9-a27b-d904316934cf-kube-api-access-8k6lt" (OuterVolumeSpecName: "kube-api-access-8k6lt") pod "c0cd405f-f34a-46b9-a27b-d904316934cf" (UID: "c0cd405f-f34a-46b9-a27b-d904316934cf"). InnerVolumeSpecName "kube-api-access-8k6lt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:35:50.990467 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:50.990439 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-util" (OuterVolumeSpecName: "util") pod "c0cd405f-f34a-46b9-a27b-d904316934cf" (UID: "c0cd405f-f34a-46b9-a27b-d904316934cf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:35:51.087264 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:51.087226 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:51.087264 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:51.087256 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cd405f-f34a-46b9-a27b-d904316934cf-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:51.087264 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:51.087265 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8k6lt\" (UniqueName: \"kubernetes.io/projected/c0cd405f-f34a-46b9-a27b-d904316934cf-kube-api-access-8k6lt\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:35:51.702497 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:51.702464 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" event={"ID":"c0cd405f-f34a-46b9-a27b-d904316934cf","Type":"ContainerDied","Data":"da362fe9b177664ccdc03ba20da5750c33e576dc6e02fe5702f00abd6b97d60e"} Jul 07 14:35:51.702497 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:51.702488 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vpprg" Jul 07 14:35:51.702704 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:51.702512 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da362fe9b177664ccdc03ba20da5750c33e576dc6e02fe5702f00abd6b97d60e" Jul 07 14:35:59.347417 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347381 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8"] Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347637 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="util" Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347647 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="util" Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347658 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="pull" Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347664 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="pull" Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347673 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="extract" Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347678 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="extract" Jul 07 14:35:59.347883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.347717 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0cd405f-f34a-46b9-a27b-d904316934cf" containerName="extract" Jul 07 14:35:59.351362 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.351344 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.353621 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.353594 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-64pdt\"" Jul 07 14:35:59.353756 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.353686 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 07 14:35:59.353756 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.353701 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 07 14:35:59.361657 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.361633 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8"] Jul 07 14:35:59.453038 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.452982 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f5745a-40d0-43fd-a1e7-2cf581939ee2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gntr8\" (UID: \"46f5745a-40d0-43fd-a1e7-2cf581939ee2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.453038 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.453040 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc5gv\" (UniqueName: \"kubernetes.io/projected/46f5745a-40d0-43fd-a1e7-2cf581939ee2-kube-api-access-kc5gv\") pod \"cert-manager-operator-controller-manager-55c444bf86-gntr8\" (UID: \"46f5745a-40d0-43fd-a1e7-2cf581939ee2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.554243 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.554189 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f5745a-40d0-43fd-a1e7-2cf581939ee2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gntr8\" (UID: \"46f5745a-40d0-43fd-a1e7-2cf581939ee2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.554420 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.554358 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc5gv\" (UniqueName: \"kubernetes.io/projected/46f5745a-40d0-43fd-a1e7-2cf581939ee2-kube-api-access-kc5gv\") pod \"cert-manager-operator-controller-manager-55c444bf86-gntr8\" (UID: \"46f5745a-40d0-43fd-a1e7-2cf581939ee2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.554588 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.554569 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f5745a-40d0-43fd-a1e7-2cf581939ee2-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-gntr8\" (UID: \"46f5745a-40d0-43fd-a1e7-2cf581939ee2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.563067 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.563040 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc5gv\" (UniqueName: \"kubernetes.io/projected/46f5745a-40d0-43fd-a1e7-2cf581939ee2-kube-api-access-kc5gv\") pod \"cert-manager-operator-controller-manager-55c444bf86-gntr8\" (UID: \"46f5745a-40d0-43fd-a1e7-2cf581939ee2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.660985 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.660858 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" Jul 07 14:35:59.796093 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:35:59.796002 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8"] Jul 07 14:35:59.799043 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:35:59.799006 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f5745a_40d0_43fd_a1e7_2cf581939ee2.slice/crio-0e30ad8106ba03a61f5d4910fe6c1443b3e8f50b02ec4ea255551959fe1ff2cc WatchSource:0}: Error finding container 0e30ad8106ba03a61f5d4910fe6c1443b3e8f50b02ec4ea255551959fe1ff2cc: Status 404 returned error can't find the container with id 0e30ad8106ba03a61f5d4910fe6c1443b3e8f50b02ec4ea255551959fe1ff2cc Jul 07 14:36:00.736511 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:00.736479 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" event={"ID":"46f5745a-40d0-43fd-a1e7-2cf581939ee2","Type":"ContainerStarted","Data":"0e30ad8106ba03a61f5d4910fe6c1443b3e8f50b02ec4ea255551959fe1ff2cc"} Jul 07 14:36:02.753536 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:02.753492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" event={"ID":"46f5745a-40d0-43fd-a1e7-2cf581939ee2","Type":"ContainerStarted","Data":"dd7e9a753d2ee9db1fd205b03126f4e65293f926edf6ead82c33248c2a244e76"} Jul 07 14:36:02.777056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:02.776998 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-gntr8" podStartSLOduration=1.428465878 podStartE2EDuration="3.776980094s" totalImagesPullingTime="2.348514216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:35:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:02.774654277 +0000 UTC m=+324.957401157" watchObservedRunningTime="2026-07-07 14:36:02.776980094 +0000 UTC m=+324.959726964" Jul 07 14:36:03.091972 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.091863 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2pgzd"] Jul 07 14:36:03.093990 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.093965 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.096227 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.096202 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 07 14:36:03.096490 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.096474 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-82hbh\"" Jul 07 14:36:03.096593 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.096540 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 07 14:36:03.106977 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.106932 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2pgzd"] Jul 07 14:36:03.185383 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.185347 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03acb0a6-f576-4a9a-ac06-6a57a40b2907-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2pgzd\" (UID: \"03acb0a6-f576-4a9a-ac06-6a57a40b2907\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.185580 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.185423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8s2q\" (UniqueName: \"kubernetes.io/projected/03acb0a6-f576-4a9a-ac06-6a57a40b2907-kube-api-access-n8s2q\") pod \"cert-manager-webhook-6486ffd997-2pgzd\" (UID: \"03acb0a6-f576-4a9a-ac06-6a57a40b2907\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.286690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.286646 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03acb0a6-f576-4a9a-ac06-6a57a40b2907-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2pgzd\" (UID: \"03acb0a6-f576-4a9a-ac06-6a57a40b2907\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.286858 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.286728 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8s2q\" (UniqueName: \"kubernetes.io/projected/03acb0a6-f576-4a9a-ac06-6a57a40b2907-kube-api-access-n8s2q\") pod \"cert-manager-webhook-6486ffd997-2pgzd\" (UID: \"03acb0a6-f576-4a9a-ac06-6a57a40b2907\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.301362 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.301331 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8s2q\" (UniqueName: \"kubernetes.io/projected/03acb0a6-f576-4a9a-ac06-6a57a40b2907-kube-api-access-n8s2q\") pod \"cert-manager-webhook-6486ffd997-2pgzd\" (UID: \"03acb0a6-f576-4a9a-ac06-6a57a40b2907\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.302056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.302034 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/03acb0a6-f576-4a9a-ac06-6a57a40b2907-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2pgzd\" (UID: \"03acb0a6-f576-4a9a-ac06-6a57a40b2907\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.416773 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.416684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:03.549844 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.549726 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2pgzd"] Jul 07 14:36:03.552505 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:03.552462 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03acb0a6_f576_4a9a_ac06_6a57a40b2907.slice/crio-bb3ccff8dd74423f74509cd59132294dbc42d9f33ad0d9d328d8def281443f74 WatchSource:0}: Error finding container bb3ccff8dd74423f74509cd59132294dbc42d9f33ad0d9d328d8def281443f74: Status 404 returned error can't find the container with id bb3ccff8dd74423f74509cd59132294dbc42d9f33ad0d9d328d8def281443f74 Jul 07 14:36:03.758170 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.758131 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" event={"ID":"03acb0a6-f576-4a9a-ac06-6a57a40b2907","Type":"ContainerStarted","Data":"bb3ccff8dd74423f74509cd59132294dbc42d9f33ad0d9d328d8def281443f74"} Jul 07 14:36:03.869333 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.869302 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4"] Jul 07 14:36:03.872522 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.872505 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:03.874709 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.874690 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:36:03.874840 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.874794 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:36:03.875584 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.875562 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bdvz2\"" Jul 07 14:36:03.881897 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.881870 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4"] Jul 07 14:36:03.992964 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.992901 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zgtxq\" (UniqueName: \"kubernetes.io/projected/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-kube-api-access-zgtxq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:03.992964 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.992965 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:03.993226 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:03.993089 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.093841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.093743 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zgtxq\" (UniqueName: \"kubernetes.io/projected/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-kube-api-access-zgtxq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.093841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.093785 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.093841 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.093838 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.094233 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.094214 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.094233 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.094226 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.102177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.102155 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zgtxq\" (UniqueName: \"kubernetes.io/projected/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-kube-api-access-zgtxq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.182962 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.182914 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:04.313161 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.313132 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4"] Jul 07 14:36:04.316166 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:04.316141 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9875e21e_cbe8_44ea_9237_88a70fd3bbfe.slice/crio-b44414cc3d9b5ebd5ac09ec0cfd3752dc1720c7568b5b8b52204b2efe1c1507f WatchSource:0}: Error finding container b44414cc3d9b5ebd5ac09ec0cfd3752dc1720c7568b5b8b52204b2efe1c1507f: Status 404 returned error can't find the container with id b44414cc3d9b5ebd5ac09ec0cfd3752dc1720c7568b5b8b52204b2efe1c1507f Jul 07 14:36:04.763177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.763145 2564 generic.go:356] "Generic (PLEG): container finished" podID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerID="4f408aecdede79b4705b88842bd84997ea7b858be63e20de3e5a5172a5ad3171" exitCode=0 Jul 07 14:36:04.763638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.763234 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" event={"ID":"9875e21e-cbe8-44ea-9237-88a70fd3bbfe","Type":"ContainerDied","Data":"4f408aecdede79b4705b88842bd84997ea7b858be63e20de3e5a5172a5ad3171"} Jul 07 14:36:04.763638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:04.763281 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" event={"ID":"9875e21e-cbe8-44ea-9237-88a70fd3bbfe","Type":"ContainerStarted","Data":"b44414cc3d9b5ebd5ac09ec0cfd3752dc1720c7568b5b8b52204b2efe1c1507f"} Jul 07 14:36:06.625855 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.625821 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn"] Jul 07 14:36:06.631792 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.631768 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.634242 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.634219 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-h8nck\"" Jul 07 14:36:06.640349 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.640010 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn"] Jul 07 14:36:06.817585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.817551 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb2nz\" (UniqueName: \"kubernetes.io/projected/3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f-kube-api-access-pb2nz\") pod \"cert-manager-cainjector-559cdd8c87-w5zxn\" (UID: \"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.817764 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.817604 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w5zxn\" (UID: \"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.918266 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.918182 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w5zxn\" (UID: \"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.918439 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.918288 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb2nz\" (UniqueName: \"kubernetes.io/projected/3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f-kube-api-access-pb2nz\") pod \"cert-manager-cainjector-559cdd8c87-w5zxn\" (UID: \"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.930461 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.930427 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-w5zxn\" (UID: \"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.930749 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.930709 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb2nz\" (UniqueName: \"kubernetes.io/projected/3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f-kube-api-access-pb2nz\") pod \"cert-manager-cainjector-559cdd8c87-w5zxn\" (UID: \"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:06.943329 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:06.943300 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" Jul 07 14:36:08.128410 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.128287 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn"] Jul 07 14:36:08.131052 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:08.131022 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3ae1b8f4_c63a_4bcb_88ad_5f3787906d8f.slice/crio-8a3fc6554e4eada0a2f7feae4fb4c169ad50d13e71860c436086c5377cbfa663 WatchSource:0}: Error finding container 8a3fc6554e4eada0a2f7feae4fb4c169ad50d13e71860c436086c5377cbfa663: Status 404 returned error can't find the container with id 8a3fc6554e4eada0a2f7feae4fb4c169ad50d13e71860c436086c5377cbfa663 Jul 07 14:36:08.784904 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.784873 2564 generic.go:356] "Generic (PLEG): container finished" podID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerID="bfbd4b2fee87c5cb47041935a2f8ddcbede678835ed52e64dfe62a12b5ff6d16" exitCode=0 Jul 07 14:36:08.785095 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.784971 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" event={"ID":"9875e21e-cbe8-44ea-9237-88a70fd3bbfe","Type":"ContainerDied","Data":"bfbd4b2fee87c5cb47041935a2f8ddcbede678835ed52e64dfe62a12b5ff6d16"} Jul 07 14:36:08.786692 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.786667 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" event={"ID":"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f","Type":"ContainerStarted","Data":"52c2cfc602ed070605530910b6e86591c10b0fb1e2ac574ca1c605642190b3b6"} Jul 07 14:36:08.786784 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.786711 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" event={"ID":"3ae1b8f4-c63a-4bcb-88ad-5f3787906d8f","Type":"ContainerStarted","Data":"8a3fc6554e4eada0a2f7feae4fb4c169ad50d13e71860c436086c5377cbfa663"} Jul 07 14:36:08.788125 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.788106 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" event={"ID":"03acb0a6-f576-4a9a-ac06-6a57a40b2907","Type":"ContainerStarted","Data":"001beb8542cee038c0a09b0b2c2bd81be5e5cb2cefea1eb459267b5d87375c0b"} Jul 07 14:36:08.788779 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.788764 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:08.826724 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.826679 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" podStartSLOduration=1.385104375 podStartE2EDuration="5.826664109s" totalImagesPullingTime="4.441559734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:08.824933069 +0000 UTC m=+331.007679942" watchObservedRunningTime="2026-07-07 14:36:08.826664109 +0000 UTC m=+331.009410979" Jul 07 14:36:08.843376 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:08.843322 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-w5zxn" podStartSLOduration=2.8432990609999997 podStartE2EDuration="2.843299061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:08.840923908 +0000 UTC m=+331.023670781" watchObservedRunningTime="2026-07-07 14:36:08.843299061 +0000 UTC m=+331.026045932" Jul 07 14:36:09.796591 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:09.796560 2564 generic.go:356] "Generic (PLEG): container finished" podID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerID="f620999445a7e459077c202ab472b7abd8dcc485bd0ca473cf88e3b24b2d6fbc" exitCode=0 Jul 07 14:36:09.797024 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:09.796651 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" event={"ID":"9875e21e-cbe8-44ea-9237-88a70fd3bbfe","Type":"ContainerDied","Data":"f620999445a7e459077c202ab472b7abd8dcc485bd0ca473cf88e3b24b2d6fbc"} Jul 07 14:36:10.925867 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:10.925836 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:11.049520 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.049486 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-bundle\") pod \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " Jul 07 14:36:11.049707 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.049569 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-util\") pod \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " Jul 07 14:36:11.049707 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.049596 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zgtxq\" (UniqueName: \"kubernetes.io/projected/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-kube-api-access-zgtxq\") pod \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\" (UID: \"9875e21e-cbe8-44ea-9237-88a70fd3bbfe\") " Jul 07 14:36:11.049910 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.049882 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-bundle" (OuterVolumeSpecName: "bundle") pod "9875e21e-cbe8-44ea-9237-88a70fd3bbfe" (UID: "9875e21e-cbe8-44ea-9237-88a70fd3bbfe"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:36:11.051789 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.051719 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-kube-api-access-zgtxq" (OuterVolumeSpecName: "kube-api-access-zgtxq") pod "9875e21e-cbe8-44ea-9237-88a70fd3bbfe" (UID: "9875e21e-cbe8-44ea-9237-88a70fd3bbfe"). InnerVolumeSpecName "kube-api-access-zgtxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:36:11.053618 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.053594 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-util" (OuterVolumeSpecName: "util") pod "9875e21e-cbe8-44ea-9237-88a70fd3bbfe" (UID: "9875e21e-cbe8-44ea-9237-88a70fd3bbfe"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:36:11.150250 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.150222 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:36:11.150250 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.150249 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zgtxq\" (UniqueName: \"kubernetes.io/projected/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-kube-api-access-zgtxq\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:36:11.150250 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.150259 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9875e21e-cbe8-44ea-9237-88a70fd3bbfe-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:36:11.806532 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.806502 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" Jul 07 14:36:11.806532 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.806512 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhd2n4" event={"ID":"9875e21e-cbe8-44ea-9237-88a70fd3bbfe","Type":"ContainerDied","Data":"b44414cc3d9b5ebd5ac09ec0cfd3752dc1720c7568b5b8b52204b2efe1c1507f"} Jul 07 14:36:11.806745 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:11.806562 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b44414cc3d9b5ebd5ac09ec0cfd3752dc1720c7568b5b8b52204b2efe1c1507f" Jul 07 14:36:14.799671 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:14.799637 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2pgzd" Jul 07 14:36:15.729786 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.729753 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7n5md"] Jul 07 14:36:15.730046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730033 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="extract" Jul 07 14:36:15.730046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730046 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="extract" Jul 07 14:36:15.730122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730070 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="pull" Jul 07 14:36:15.730122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730076 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="pull" Jul 07 14:36:15.730122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730090 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="util" Jul 07 14:36:15.730122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730095 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="util" Jul 07 14:36:15.730238 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.730139 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="9875e21e-cbe8-44ea-9237-88a70fd3bbfe" containerName="extract" Jul 07 14:36:15.732235 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.732219 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:15.734217 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.734194 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-gxpfx\"" Jul 07 14:36:15.742403 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.742374 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7n5md"] Jul 07 14:36:15.783255 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.783221 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b571ed2-54e0-4bde-938c-a23431632236-bound-sa-token\") pod \"cert-manager-55b4d954d5-7n5md\" (UID: \"6b571ed2-54e0-4bde-938c-a23431632236\") " pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:15.783430 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.783275 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47z5s\" (UniqueName: \"kubernetes.io/projected/6b571ed2-54e0-4bde-938c-a23431632236-kube-api-access-47z5s\") pod \"cert-manager-55b4d954d5-7n5md\" (UID: \"6b571ed2-54e0-4bde-938c-a23431632236\") " pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:15.883669 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.883618 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b571ed2-54e0-4bde-938c-a23431632236-bound-sa-token\") pod \"cert-manager-55b4d954d5-7n5md\" (UID: \"6b571ed2-54e0-4bde-938c-a23431632236\") " pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:15.884134 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.883706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47z5s\" (UniqueName: \"kubernetes.io/projected/6b571ed2-54e0-4bde-938c-a23431632236-kube-api-access-47z5s\") pod \"cert-manager-55b4d954d5-7n5md\" (UID: \"6b571ed2-54e0-4bde-938c-a23431632236\") " pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:15.892359 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.892333 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6b571ed2-54e0-4bde-938c-a23431632236-bound-sa-token\") pod \"cert-manager-55b4d954d5-7n5md\" (UID: \"6b571ed2-54e0-4bde-938c-a23431632236\") " pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:15.892528 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:15.892504 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47z5s\" (UniqueName: \"kubernetes.io/projected/6b571ed2-54e0-4bde-938c-a23431632236-kube-api-access-47z5s\") pod \"cert-manager-55b4d954d5-7n5md\" (UID: \"6b571ed2-54e0-4bde-938c-a23431632236\") " pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:16.041635 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:16.041542 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-7n5md" Jul 07 14:36:16.170444 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:16.170280 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-7n5md"] Jul 07 14:36:16.172539 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:16.172516 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6b571ed2_54e0_4bde_938c_a23431632236.slice/crio-3689272cd789fe1d99c856a2266e26c7bcc89dc53aad84de394a30e435bb87c6 WatchSource:0}: Error finding container 3689272cd789fe1d99c856a2266e26c7bcc89dc53aad84de394a30e435bb87c6: Status 404 returned error can't find the container with id 3689272cd789fe1d99c856a2266e26c7bcc89dc53aad84de394a30e435bb87c6 Jul 07 14:36:16.829876 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:16.829842 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7n5md" event={"ID":"6b571ed2-54e0-4bde-938c-a23431632236","Type":"ContainerStarted","Data":"89a19dbd2dbff6a9d30e30e8f251c61237f13213eb7e0a367df6cd291a0c7f2b"} Jul 07 14:36:16.830068 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:16.829893 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-7n5md" event={"ID":"6b571ed2-54e0-4bde-938c-a23431632236","Type":"ContainerStarted","Data":"3689272cd789fe1d99c856a2266e26c7bcc89dc53aad84de394a30e435bb87c6"} Jul 07 14:36:16.854205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:16.854142 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-7n5md" podStartSLOduration=1.8541205440000001 podStartE2EDuration="1.854120544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:16.853968179 +0000 UTC m=+339.036715050" watchObservedRunningTime="2026-07-07 14:36:16.854120544 +0000 UTC m=+339.036867415" Jul 07 14:36:24.121440 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.121406 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r"] Jul 07 14:36:24.126269 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.126247 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.128923 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.128897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 07 14:36:24.128923 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.128897 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 07 14:36:24.129842 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.129822 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-bdvz2\"" Jul 07 14:36:24.134345 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.134324 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r"] Jul 07 14:36:24.148549 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.148510 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.148730 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.148595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.148730 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.148637 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmb8g\" (UniqueName: \"kubernetes.io/projected/00e7150e-c2e1-42a5-81b2-90adc5f20053-kube-api-access-kmb8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.249485 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.249441 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.249675 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.249510 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.249675 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.249634 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmb8g\" (UniqueName: \"kubernetes.io/projected/00e7150e-c2e1-42a5-81b2-90adc5f20053-kube-api-access-kmb8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.249877 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.249860 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.249972 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.249892 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.259518 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.259492 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmb8g\" (UniqueName: \"kubernetes.io/projected/00e7150e-c2e1-42a5-81b2-90adc5f20053-kube-api-access-kmb8g\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.436655 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.436544 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:24.572145 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.572028 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r"] Jul 07 14:36:24.574660 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:24.574631 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e7150e_c2e1_42a5_81b2_90adc5f20053.slice/crio-3d5d9a6efb3574932af918e761c94599dbb305f0b9cce001fdc3dcdc8fb43014 WatchSource:0}: Error finding container 3d5d9a6efb3574932af918e761c94599dbb305f0b9cce001fdc3dcdc8fb43014: Status 404 returned error can't find the container with id 3d5d9a6efb3574932af918e761c94599dbb305f0b9cce001fdc3dcdc8fb43014 Jul 07 14:36:24.861196 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.861162 2564 generic.go:356] "Generic (PLEG): container finished" podID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerID="8528442b6d98aec613d967e2599d8ffb489879f1f643c3fa94c8bf4309f1f061" exitCode=0 Jul 07 14:36:24.861376 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.861249 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" event={"ID":"00e7150e-c2e1-42a5-81b2-90adc5f20053","Type":"ContainerDied","Data":"8528442b6d98aec613d967e2599d8ffb489879f1f643c3fa94c8bf4309f1f061"} Jul 07 14:36:24.861376 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:24.861300 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" event={"ID":"00e7150e-c2e1-42a5-81b2-90adc5f20053","Type":"ContainerStarted","Data":"3d5d9a6efb3574932af918e761c94599dbb305f0b9cce001fdc3dcdc8fb43014"} Jul 07 14:36:25.867500 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:25.867409 2564 generic.go:356] "Generic (PLEG): container finished" podID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerID="9beedef2f4a375be0ac2266763fd6970f2b66750d0c72e7b9d4234cbadf6454f" exitCode=0 Jul 07 14:36:25.867867 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:25.867492 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" event={"ID":"00e7150e-c2e1-42a5-81b2-90adc5f20053","Type":"ContainerDied","Data":"9beedef2f4a375be0ac2266763fd6970f2b66750d0c72e7b9d4234cbadf6454f"} Jul 07 14:36:26.874232 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:26.874194 2564 generic.go:356] "Generic (PLEG): container finished" podID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerID="67ad1f3bc44c60c93b4ce148f9cdacd9edaa55d8c425e4dca0e857d45e3c7172" exitCode=0 Jul 07 14:36:26.874636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:26.874253 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" event={"ID":"00e7150e-c2e1-42a5-81b2-90adc5f20053","Type":"ContainerDied","Data":"67ad1f3bc44c60c93b4ce148f9cdacd9edaa55d8c425e4dca0e857d45e3c7172"} Jul 07 14:36:28.012134 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.012108 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:28.076346 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.076303 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmb8g\" (UniqueName: \"kubernetes.io/projected/00e7150e-c2e1-42a5-81b2-90adc5f20053-kube-api-access-kmb8g\") pod \"00e7150e-c2e1-42a5-81b2-90adc5f20053\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " Jul 07 14:36:28.076553 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.076368 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-util\") pod \"00e7150e-c2e1-42a5-81b2-90adc5f20053\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " Jul 07 14:36:28.076553 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.076444 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-bundle\") pod \"00e7150e-c2e1-42a5-81b2-90adc5f20053\" (UID: \"00e7150e-c2e1-42a5-81b2-90adc5f20053\") " Jul 07 14:36:28.077138 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.077101 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-bundle" (OuterVolumeSpecName: "bundle") pod "00e7150e-c2e1-42a5-81b2-90adc5f20053" (UID: "00e7150e-c2e1-42a5-81b2-90adc5f20053"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:36:28.078484 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.078453 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00e7150e-c2e1-42a5-81b2-90adc5f20053-kube-api-access-kmb8g" (OuterVolumeSpecName: "kube-api-access-kmb8g") pod "00e7150e-c2e1-42a5-81b2-90adc5f20053" (UID: "00e7150e-c2e1-42a5-81b2-90adc5f20053"). InnerVolumeSpecName "kube-api-access-kmb8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:36:28.082011 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.081976 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-util" (OuterVolumeSpecName: "util") pod "00e7150e-c2e1-42a5-81b2-90adc5f20053" (UID: "00e7150e-c2e1-42a5-81b2-90adc5f20053"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:36:28.177600 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.177506 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:36:28.177600 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.177538 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmb8g\" (UniqueName: \"kubernetes.io/projected/00e7150e-c2e1-42a5-81b2-90adc5f20053-kube-api-access-kmb8g\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:36:28.177600 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.177548 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/00e7150e-c2e1-42a5-81b2-90adc5f20053-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:36:28.884755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.884670 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" Jul 07 14:36:28.884755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.884681 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afzjx9r" event={"ID":"00e7150e-c2e1-42a5-81b2-90adc5f20053","Type":"ContainerDied","Data":"3d5d9a6efb3574932af918e761c94599dbb305f0b9cce001fdc3dcdc8fb43014"} Jul 07 14:36:28.884755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:28.884726 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d5d9a6efb3574932af918e761c94599dbb305f0b9cce001fdc3dcdc8fb43014" Jul 07 14:36:37.028217 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028131 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg"] Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028400 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="extract" Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028410 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="extract" Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028423 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="pull" Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028429 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="pull" Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028441 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="util" Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028449 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="util" Jul 07 14:36:37.028585 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.028524 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="00e7150e-c2e1-42a5-81b2-90adc5f20053" containerName="extract" Jul 07 14:36:37.030753 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.030736 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.033079 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.033049 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dnrkb\"" Jul 07 14:36:37.033079 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.033074 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 07 14:36:37.033245 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.033087 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 07 14:36:37.033385 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.033366 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 07 14:36:37.033478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.033462 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 07 14:36:37.048442 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.048406 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg"] Jul 07 14:36:37.147611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.147575 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1c691bd-472f-46c6-a74c-32b501a4bc96-tmp\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.147611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.147612 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c691bd-472f-46c6-a74c-32b501a4bc96-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.147855 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.147634 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1c691bd-472f-46c6-a74c-32b501a4bc96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.147855 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.147701 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9f89\" (UniqueName: \"kubernetes.io/projected/a1c691bd-472f-46c6-a74c-32b501a4bc96-kube-api-access-l9f89\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.147855 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.147787 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1c691bd-472f-46c6-a74c-32b501a4bc96-manifests\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.249106 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.249058 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1c691bd-472f-46c6-a74c-32b501a4bc96-tmp\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.249293 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.249120 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c691bd-472f-46c6-a74c-32b501a4bc96-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.249293 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.249159 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1c691bd-472f-46c6-a74c-32b501a4bc96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.249293 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.249178 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9f89\" (UniqueName: \"kubernetes.io/projected/a1c691bd-472f-46c6-a74c-32b501a4bc96-kube-api-access-l9f89\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.249293 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.249229 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1c691bd-472f-46c6-a74c-32b501a4bc96-manifests\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.249628 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.249599 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a1c691bd-472f-46c6-a74c-32b501a4bc96-manifests\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.251446 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.251425 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a1c691bd-472f-46c6-a74c-32b501a4bc96-tmp\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.251661 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.251641 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a1c691bd-472f-46c6-a74c-32b501a4bc96-webhook-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.251734 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.251664 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a1c691bd-472f-46c6-a74c-32b501a4bc96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.261222 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.261195 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9f89\" (UniqueName: \"kubernetes.io/projected/a1c691bd-472f-46c6-a74c-32b501a4bc96-kube-api-access-l9f89\") pod \"opendatahub-operator-controller-manager-7d7f589f9f-4ktqg\" (UID: \"a1c691bd-472f-46c6-a74c-32b501a4bc96\") " pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.341883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.341788 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:37.485568 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.485539 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg"] Jul 07 14:36:37.487327 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:37.487297 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c691bd_472f_46c6_a74c_32b501a4bc96.slice/crio-935e97369b4901a376098d2cbbc2bd93404e91a260a4aca3d298fc8e94529ad8 WatchSource:0}: Error finding container 935e97369b4901a376098d2cbbc2bd93404e91a260a4aca3d298fc8e94529ad8: Status 404 returned error can't find the container with id 935e97369b4901a376098d2cbbc2bd93404e91a260a4aca3d298fc8e94529ad8 Jul 07 14:36:37.925869 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:37.925831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" event={"ID":"a1c691bd-472f-46c6-a74c-32b501a4bc96","Type":"ContainerStarted","Data":"935e97369b4901a376098d2cbbc2bd93404e91a260a4aca3d298fc8e94529ad8"} Jul 07 14:36:40.944650 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:40.944616 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" event={"ID":"a1c691bd-472f-46c6-a74c-32b501a4bc96","Type":"ContainerStarted","Data":"3ddd8abc1bcee5ba847bd2a2a8bf9ad62d3ff6e38dbd96f9da4e2972f1074384"} Jul 07 14:36:42.958456 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:42.958417 2564 generic.go:356] "Generic (PLEG): container finished" podID="a1c691bd-472f-46c6-a74c-32b501a4bc96" containerID="3ddd8abc1bcee5ba847bd2a2a8bf9ad62d3ff6e38dbd96f9da4e2972f1074384" exitCode=0 Jul 07 14:36:42.958864 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:42.958487 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" event={"ID":"a1c691bd-472f-46c6-a74c-32b501a4bc96","Type":"ContainerDied","Data":"3ddd8abc1bcee5ba847bd2a2a8bf9ad62d3ff6e38dbd96f9da4e2972f1074384"} Jul 07 14:36:43.964409 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:43.964319 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" event={"ID":"a1c691bd-472f-46c6-a74c-32b501a4bc96","Type":"ContainerStarted","Data":"c4c1cf23157902cf29129775c476aff827393262302d5318311bdd6a66ce4dc7"} Jul 07 14:36:43.964772 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:43.964539 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:43.990020 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:43.989963 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" podStartSLOduration=2.889352754 podStartE2EDuration="7.98992586s" totalImagesPullingTime="3.941635427s" totalInitContainerRuntime="1.158937679s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:36 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:36:43.987417681 +0000 UTC m=+366.170164545" watchObservedRunningTime="2026-07-07 14:36:43.98992586 +0000 UTC m=+366.172672805" Jul 07 14:36:54.971035 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:54.971004 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7d7f589f9f-4ktqg" Jul 07 14:36:57.393800 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.393768 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm"] Jul 07 14:36:57.404763 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.404730 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.411726 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.411704 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b6zmd\"" Jul 07 14:36:57.411831 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.411724 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 07 14:36:57.412433 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.412418 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 07 14:36:57.412510 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.412441 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 07 14:36:57.412735 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.412711 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 07 14:36:57.428582 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.428550 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm"] Jul 07 14:36:57.525196 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.525158 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl9v8\" (UniqueName: \"kubernetes.io/projected/37874349-20d7-4524-bba5-1e4aa0955a86-kube-api-access-tl9v8\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.525196 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.525199 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37874349-20d7-4524-bba5-1e4aa0955a86-tmp\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.525446 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.525317 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37874349-20d7-4524-bba5-1e4aa0955a86-tls-certs\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.626407 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.626368 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37874349-20d7-4524-bba5-1e4aa0955a86-tls-certs\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.626602 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.626474 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl9v8\" (UniqueName: \"kubernetes.io/projected/37874349-20d7-4524-bba5-1e4aa0955a86-kube-api-access-tl9v8\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.626602 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.626513 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37874349-20d7-4524-bba5-1e4aa0955a86-tmp\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.628696 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.628673 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/37874349-20d7-4524-bba5-1e4aa0955a86-tmp\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.628848 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.628833 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37874349-20d7-4524-bba5-1e4aa0955a86-tls-certs\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.642804 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.642776 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl9v8\" (UniqueName: \"kubernetes.io/projected/37874349-20d7-4524-bba5-1e4aa0955a86-kube-api-access-tl9v8\") pod \"kube-auth-proxy-67499f45fb-9g4xm\" (UID: \"37874349-20d7-4524-bba5-1e4aa0955a86\") " pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.714782 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.714696 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" Jul 07 14:36:57.869093 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.868971 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm"] Jul 07 14:36:57.871130 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:57.871100 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37874349_20d7_4524_bba5_1e4aa0955a86.slice/crio-e59c101f744bb4e90770a23aef28db43dd5a60db426bafed650713f713101ca1 WatchSource:0}: Error finding container e59c101f744bb4e90770a23aef28db43dd5a60db426bafed650713f713101ca1: Status 404 returned error can't find the container with id e59c101f744bb4e90770a23aef28db43dd5a60db426bafed650713f713101ca1 Jul 07 14:36:57.879964 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.879921 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zrq9p"] Jul 07 14:36:57.883269 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.883251 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:57.886165 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.886145 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qzntz\"" Jul 07 14:36:57.886402 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.886389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 07 14:36:57.898127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:57.898095 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zrq9p"] Jul 07 14:36:58.027182 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.027149 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" event={"ID":"37874349-20d7-4524-bba5-1e4aa0955a86","Type":"ContainerStarted","Data":"e59c101f744bb4e90770a23aef28db43dd5a60db426bafed650713f713101ca1"} Jul 07 14:36:58.030567 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.030540 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ed262-934b-400f-bcd4-0c507131470a-cert\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.030728 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.030577 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwtbz\" (UniqueName: \"kubernetes.io/projected/492ed262-934b-400f-bcd4-0c507131470a-kube-api-access-dwtbz\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.131618 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.131585 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ed262-934b-400f-bcd4-0c507131470a-cert\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.131785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.131628 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwtbz\" (UniqueName: \"kubernetes.io/projected/492ed262-934b-400f-bcd4-0c507131470a-kube-api-access-dwtbz\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.131785 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:36:58.131731 2564 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 07 14:36:58.131876 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:36:58.131806 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/492ed262-934b-400f-bcd4-0c507131470a-cert podName:492ed262-934b-400f-bcd4-0c507131470a nodeName:}" failed. No retries permitted until 2026-07-07 14:36:58.631786666 +0000 UTC m=+380.814533514 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/492ed262-934b-400f-bcd4-0c507131470a-cert") pod "odh-model-controller-7998c67dc4-zrq9p" (UID: "492ed262-934b-400f-bcd4-0c507131470a") : secret "odh-model-controller-webhook-cert" not found Jul 07 14:36:58.148827 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.148793 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwtbz\" (UniqueName: \"kubernetes.io/projected/492ed262-934b-400f-bcd4-0c507131470a-kube-api-access-dwtbz\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.635875 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.635828 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ed262-934b-400f-bcd4-0c507131470a-cert\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.639776 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.638895 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/492ed262-934b-400f-bcd4-0c507131470a-cert\") pod \"odh-model-controller-7998c67dc4-zrq9p\" (UID: \"492ed262-934b-400f-bcd4-0c507131470a\") " pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.794003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.793961 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:36:58.964257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:58.964216 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-zrq9p"] Jul 07 14:36:58.966684 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:58.966659 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492ed262_934b_400f_bcd4_0c507131470a.slice/crio-d06e70d5c5ac6116a5e59c7c162407bd9aa3baee1b7cb53fd072c726400c29a5 WatchSource:0}: Error finding container d06e70d5c5ac6116a5e59c7c162407bd9aa3baee1b7cb53fd072c726400c29a5: Status 404 returned error can't find the container with id d06e70d5c5ac6116a5e59c7c162407bd9aa3baee1b7cb53fd072c726400c29a5 Jul 07 14:36:59.033646 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.033604 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" event={"ID":"492ed262-934b-400f-bcd4-0c507131470a","Type":"ContainerStarted","Data":"d06e70d5c5ac6116a5e59c7c162407bd9aa3baee1b7cb53fd072c726400c29a5"} Jul 07 14:36:59.081569 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.081524 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xckvx"] Jul 07 14:36:59.084959 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.084921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.088593 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.088569 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 07 14:36:59.088747 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.088640 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-t4l7s\"" Jul 07 14:36:59.097973 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.097925 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xckvx"] Jul 07 14:36:59.242267 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.242237 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qn47\" (UniqueName: \"kubernetes.io/projected/3271759e-b456-42e2-8cbf-8b268c571891-kube-api-access-6qn47\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.242457 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.242299 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3271759e-b456-42e2-8cbf-8b268c571891-tls-certs\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.285642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.285603 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b994n"] Jul 07 14:36:59.288139 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.288118 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.291390 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.291372 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 07 14:36:59.291769 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.291751 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 07 14:36:59.291987 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.291933 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 07 14:36:59.292199 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.292183 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 07 14:36:59.292289 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.292206 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-4ql6s\"" Jul 07 14:36:59.314702 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.314667 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b994n"] Jul 07 14:36:59.342729 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.342696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3271759e-b456-42e2-8cbf-8b268c571891-tls-certs\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.342906 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.342762 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qn47\" (UniqueName: \"kubernetes.io/projected/3271759e-b456-42e2-8cbf-8b268c571891-kube-api-access-6qn47\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.342906 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:36:59.342861 2564 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 07 14:36:59.342996 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:36:59.342957 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3271759e-b456-42e2-8cbf-8b268c571891-tls-certs podName:3271759e-b456-42e2-8cbf-8b268c571891 nodeName:}" failed. No retries permitted until 2026-07-07 14:36:59.842918296 +0000 UTC m=+382.025665144 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3271759e-b456-42e2-8cbf-8b268c571891-tls-certs") pod "model-serving-api-54d89bd5fc-xckvx" (UID: "3271759e-b456-42e2-8cbf-8b268c571891") : secret "model-serving-api-tls" not found Jul 07 14:36:59.351990 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.351965 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qn47\" (UniqueName: \"kubernetes.io/projected/3271759e-b456-42e2-8cbf-8b268c571891-kube-api-access-6qn47\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.443762 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.443718 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.443979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.443768 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.443979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.443795 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97f22\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-kube-api-access-97f22\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.443979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.443927 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-token\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.444169 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.443997 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-cacerts\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.444169 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.444055 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.444169 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.444101 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-local-certs\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544604 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544507 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-local-certs\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544604 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544556 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544604 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544576 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544604 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544594 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97f22\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-kube-api-access-97f22\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544975 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544630 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-token\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544975 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544653 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-cacerts\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.544975 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.544688 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.545424 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.545390 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.547134 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.547103 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-local-certs\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.547263 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.547152 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.547322 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.547275 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.547322 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.547273 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-cacerts\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.557579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.557552 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97f22\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-kube-api-access-97f22\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.557579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.557572 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-token\") pod \"istiod-openshift-gateway-7574459656-b994n\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.599205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.599169 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:36:59.784531 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.784498 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b994n"] Jul 07 14:36:59.786652 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:36:59.786619 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19dd10cb_16c7_4e9a_b6c6_0cb6b4895fc3.slice/crio-073599e2747a52cdaebd2b16b156f8da5c4252fc040c0348baa95ddb64a5131f WatchSource:0}: Error finding container 073599e2747a52cdaebd2b16b156f8da5c4252fc040c0348baa95ddb64a5131f: Status 404 returned error can't find the container with id 073599e2747a52cdaebd2b16b156f8da5c4252fc040c0348baa95ddb64a5131f Jul 07 14:36:59.848244 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.848122 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3271759e-b456-42e2-8cbf-8b268c571891-tls-certs\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.851816 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.851781 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3271759e-b456-42e2-8cbf-8b268c571891-tls-certs\") pod \"model-serving-api-54d89bd5fc-xckvx\" (UID: \"3271759e-b456-42e2-8cbf-8b268c571891\") " pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:36:59.997722 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:36:59.997686 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:37:00.042866 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:00.042809 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" event={"ID":"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3","Type":"ContainerStarted","Data":"073599e2747a52cdaebd2b16b156f8da5c4252fc040c0348baa95ddb64a5131f"} Jul 07 14:37:00.173519 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:00.173089 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-xckvx"] Jul 07 14:37:00.177122 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:37:00.176511 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3271759e_b456_42e2_8cbf_8b268c571891.slice/crio-16a9ab1612c1da1c3b491e926dd8933148ff109dcf49078df086092d84725e96 WatchSource:0}: Error finding container 16a9ab1612c1da1c3b491e926dd8933148ff109dcf49078df086092d84725e96: Status 404 returned error can't find the container with id 16a9ab1612c1da1c3b491e926dd8933148ff109dcf49078df086092d84725e96 Jul 07 14:37:01.050540 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:01.050490 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" event={"ID":"3271759e-b456-42e2-8cbf-8b268c571891","Type":"ContainerStarted","Data":"16a9ab1612c1da1c3b491e926dd8933148ff109dcf49078df086092d84725e96"} Jul 07 14:37:04.066122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:04.066070 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:04.066508 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:04.066170 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:05.074665 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.074615 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" event={"ID":"492ed262-934b-400f-bcd4-0c507131470a","Type":"ContainerStarted","Data":"45dd653bd0b3b78336db12facd2d36f6dc6278ba18efd843ffecca93f16fa253"} Jul 07 14:37:05.075205 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.074707 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:37:05.076731 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.076696 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" event={"ID":"3271759e-b456-42e2-8cbf-8b268c571891","Type":"ContainerStarted","Data":"476f97a05567fce7f5ba45e79aeefcc871e9ccca8b7de249165b07e91a81203e"} Jul 07 14:37:05.077735 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.077691 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:37:05.079108 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.079047 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" event={"ID":"37874349-20d7-4524-bba5-1e4aa0955a86","Type":"ContainerStarted","Data":"f23e30bd7a6497dcffe6fdce15cba0151ce42cdc8af15ce6d2d7aad35976324a"} Jul 07 14:37:05.081167 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.081110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" event={"ID":"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3","Type":"ContainerStarted","Data":"0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b"} Jul 07 14:37:05.081533 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.081490 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:37:05.083755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.083448 2564 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-b994n container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 07 14:37:05.083755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.083509 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" podUID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 07 14:37:05.096704 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.096650 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" podStartSLOduration=3.003477872 podStartE2EDuration="8.096631361s" totalImagesPullingTime="5.093153489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:05.095393407 +0000 UTC m=+387.278140289" watchObservedRunningTime="2026-07-07 14:37:05.096631361 +0000 UTC m=+387.279378231" Jul 07 14:37:05.115610 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.115549 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" podStartSLOduration=1.841849624 podStartE2EDuration="6.115528097s" totalImagesPullingTime="4.273678473s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:05.114731057 +0000 UTC m=+387.297477928" watchObservedRunningTime="2026-07-07 14:37:05.115528097 +0000 UTC m=+387.298274968" Jul 07 14:37:05.135110 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.135056 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-67499f45fb-9g4xm" podStartSLOduration=1.985250641 podStartE2EDuration="8.135037572s" totalImagesPullingTime="6.149786931s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:05.132845286 +0000 UTC m=+387.315592157" watchObservedRunningTime="2026-07-07 14:37:05.135037572 +0000 UTC m=+387.317784442" Jul 07 14:37:05.153100 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.152989 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" podStartSLOduration=2.26616524 podStartE2EDuration="6.152967908s" totalImagesPullingTime="3.886802668s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:36:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:05.151703063 +0000 UTC m=+387.334449934" watchObservedRunningTime="2026-07-07 14:37:05.152967908 +0000 UTC m=+387.335714783" Jul 07 14:37:05.376762 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.376680 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8"] Jul 07 14:37:05.379075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.379057 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.385072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.385047 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hzd7j\"" Jul 07 14:37:05.430592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.430556 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8"] Jul 07 14:37:05.499290 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499255 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a91899a-405f-439b-9da4-8c16dca3c433-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499490 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499338 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499490 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499370 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a91899a-405f-439b-9da4-8c16dca3c433-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499490 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499435 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499616 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499518 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f52m8\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-kube-api-access-f52m8\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499616 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499584 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499708 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499626 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499708 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.499794 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.499711 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601159 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601082 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a91899a-405f-439b-9da4-8c16dca3c433-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601187 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601212 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a91899a-405f-439b-9da4-8c16dca3c433-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601268 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601341 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f52m8\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-kube-api-access-f52m8\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601426 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601484 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601515 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601564 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.601865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.601838 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.602116 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.602091 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.602197 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.602150 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a91899a-405f-439b-9da4-8c16dca3c433-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.602448 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.602418 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.602888 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.602823 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.604099 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.604079 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a91899a-405f-439b-9da4-8c16dca3c433-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.604185 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.604085 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.605316 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.605297 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c"] Jul 07 14:37:05.608656 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.608637 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.613740 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.613708 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.615228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.615201 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f52m8\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-kube-api-access-f52m8\") pod \"data-science-gateway-data-science-gateway-class-548557588-ddnm8\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.626820 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.626724 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c"] Jul 07 14:37:05.689171 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.689139 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:05.703066 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703201 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703080 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703201 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703110 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703201 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703129 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703413 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703266 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703413 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703294 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcdns\" (UniqueName: \"kubernetes.io/projected/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-kube-api-access-lcdns\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703413 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703356 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703420 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.703594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.703485 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.804741 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804706 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804750 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804789 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804812 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804842 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804875 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.804897 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805086 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805121 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcdns\" (UniqueName: \"kubernetes.io/projected/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-kube-api-access-lcdns\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805185 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805218 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805353 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805294 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805580 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805417 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.805755 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.805736 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.807263 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.807238 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.807391 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.807376 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.822039 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.822010 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.822157 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.822122 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcdns\" (UniqueName: \"kubernetes.io/projected/f14fe716-994d-4ab9-9a2e-6f7a09975e2d-kube-api-access-lcdns\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678wm46c\" (UID: \"f14fe716-994d-4ab9-9a2e-6f7a09975e2d\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:05.841268 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.841222 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8"] Jul 07 14:37:05.847872 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:37:05.847842 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a91899a_405f_439b_9da4_8c16dca3c433.slice/crio-6a8c7d0ee06d6c6df4d4f61538bb14d71fa03fd1740796e254d50a876fa3c4a4 WatchSource:0}: Error finding container 6a8c7d0ee06d6c6df4d4f61538bb14d71fa03fd1740796e254d50a876fa3c4a4: Status 404 returned error can't find the container with id 6a8c7d0ee06d6c6df4d4f61538bb14d71fa03fd1740796e254d50a876fa3c4a4 Jul 07 14:37:05.937982 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:05.937878 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:06.087234 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:06.087194 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" event={"ID":"0a91899a-405f-439b-9da4-8c16dca3c433","Type":"ContainerStarted","Data":"6a8c7d0ee06d6c6df4d4f61538bb14d71fa03fd1740796e254d50a876fa3c4a4"} Jul 07 14:37:06.088339 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:06.088318 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:37:06.099571 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:06.099547 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c"] Jul 07 14:37:06.100822 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:37:06.100797 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14fe716_994d_4ab9_9a2e_6f7a09975e2d.slice/crio-25dd916b35d2a592c19c3fa2a617f336f4659198d86fd03cb52dc35ccb5afdcd WatchSource:0}: Error finding container 25dd916b35d2a592c19c3fa2a617f336f4659198d86fd03cb52dc35ccb5afdcd: Status 404 returned error can't find the container with id 25dd916b35d2a592c19c3fa2a617f336f4659198d86fd03cb52dc35ccb5afdcd Jul 07 14:37:07.099119 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:07.099052 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" event={"ID":"f14fe716-994d-4ab9-9a2e-6f7a09975e2d","Type":"ContainerStarted","Data":"25dd916b35d2a592c19c3fa2a617f336f4659198d86fd03cb52dc35ccb5afdcd"} Jul 07 14:37:08.949656 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.949621 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz"] Jul 07 14:37:08.951923 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.951899 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:08.955689 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.955658 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 07 14:37:08.956481 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.956450 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-svpvw\"" Jul 07 14:37:08.966037 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.965996 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:08.966139 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.966091 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:08.966216 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.966146 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:08.972798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.972757 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:08.972868 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.972853 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:08.972907 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.972895 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:37:08.987638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:08.987609 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz"] Jul 07 14:37:09.037295 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.037274 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmtlq\" (UniqueName: \"kubernetes.io/projected/fa910f89-bc15-409e-a179-3dcf5c1abcda-kube-api-access-zmtlq\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.037443 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.037423 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa910f89-bc15-409e-a179-3dcf5c1abcda-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.113146 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.113102 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" event={"ID":"f14fe716-994d-4ab9-9a2e-6f7a09975e2d","Type":"ContainerStarted","Data":"2c363e3d132f7e7b714250a09652744040f23d2bc4ae9145de59fa1391bd77b8"} Jul 07 14:37:09.116047 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.116008 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" event={"ID":"0a91899a-405f-439b-9da4-8c16dca3c433","Type":"ContainerStarted","Data":"a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f"} Jul 07 14:37:09.138968 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.138896 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa910f89-bc15-409e-a179-3dcf5c1abcda-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.138968 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.138971 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmtlq\" (UniqueName: \"kubernetes.io/projected/fa910f89-bc15-409e-a179-3dcf5c1abcda-kube-api-access-zmtlq\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.139751 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:37:09.139644 2564 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 07 14:37:09.139751 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:37:09.139748 2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa910f89-bc15-409e-a179-3dcf5c1abcda-cert podName:fa910f89-bc15-409e-a179-3dcf5c1abcda nodeName:}" failed. No retries permitted until 2026-07-07 14:37:09.639717977 +0000 UTC m=+391.822464830 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fa910f89-bc15-409e-a179-3dcf5c1abcda-cert") pod "llmisvc-controller-manager-777c6bd7d5-8fmlz" (UID: "fa910f89-bc15-409e-a179-3dcf5c1abcda") : secret "llmisvc-webhook-server-cert" not found Jul 07 14:37:09.151509 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.151445 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" podStartSLOduration=1.288513677 podStartE2EDuration="4.151420285s" totalImagesPullingTime="2.862906608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:09.148506794 +0000 UTC m=+391.331253665" watchObservedRunningTime="2026-07-07 14:37:09.151420285 +0000 UTC m=+391.334167136" Jul 07 14:37:09.156012 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.155981 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmtlq\" (UniqueName: \"kubernetes.io/projected/fa910f89-bc15-409e-a179-3dcf5c1abcda-kube-api-access-zmtlq\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.179927 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.179845 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" podStartSLOduration=1.057156544 podStartE2EDuration="4.179827803s" totalImagesPullingTime="3.122671259s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:09.178012653 +0000 UTC m=+391.360759534" watchObservedRunningTime="2026-07-07 14:37:09.179827803 +0000 UTC m=+391.362574673" Jul 07 14:37:09.642501 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.642458 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa910f89-bc15-409e-a179-3dcf5c1abcda-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.644993 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.644961 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fa910f89-bc15-409e-a179-3dcf5c1abcda-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-8fmlz\" (UID: \"fa910f89-bc15-409e-a179-3dcf5c1abcda\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.690122 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.690083 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:09.862688 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.862653 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:09.938454 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:09.938423 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:10.015568 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.015509 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz"] Jul 07 14:37:10.110594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.110559 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b994n"] Jul 07 14:37:10.110793 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.110770 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" podUID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" containerName="discovery" containerID="cri-o://0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b" gracePeriod=30 Jul 07 14:37:10.122851 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.122808 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" event={"ID":"fa910f89-bc15-409e-a179-3dcf5c1abcda","Type":"ContainerStarted","Data":"1650dfd09c2b2b9623e07b918800cc0caa2cedc574263ef387fd221945890555"} Jul 07 14:37:10.369327 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.369296 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:37:10.450732 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450700 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-kubeconfig\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.450732 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450738 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-cacerts\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.451019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450776 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-token\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.451019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450803 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-dns-cert\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.451019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450822 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-ca-configmap\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.451019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450884 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97f22\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-kube-api-access-97f22\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.451019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.450907 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-local-certs\") pod \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\" (UID: \"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3\") " Jul 07 14:37:10.451304 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.451277 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:37:10.453284 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.453248 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-cacerts" (OuterVolumeSpecName: "cacerts") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:37:10.453436 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.453418 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-kube-api-access-97f22" (OuterVolumeSpecName: "kube-api-access-97f22") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "kube-api-access-97f22". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:37:10.453677 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.453655 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-token" (OuterVolumeSpecName: "istio-token") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:37:10.453677 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.453654 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-local-certs" (OuterVolumeSpecName: "local-certs") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:37:10.453677 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.453679 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:37:10.453854 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.453704 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" (UID: "19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:37:10.551663 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551626 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-token\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.551663 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551659 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-dns-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.551865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551676 2564 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-csr-ca-configmap\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.551865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551690 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97f22\" (UniqueName: \"kubernetes.io/projected/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-kube-api-access-97f22\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.551865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551707 2564 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-local-certs\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.551865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551719 2564 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-istio-kubeconfig\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.551865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.551730 2564 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3-cacerts\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:10.691724 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.691673 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-ddnm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 07 14:37:10.691895 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.691746 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 07 14:37:10.943112 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:10.943021 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:11.129110 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.129075 2564 generic.go:356] "Generic (PLEG): container finished" podID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" containerID="0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b" exitCode=0 Jul 07 14:37:11.129541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.129125 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" Jul 07 14:37:11.129541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.129137 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" event={"ID":"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3","Type":"ContainerDied","Data":"0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b"} Jul 07 14:37:11.129541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.129190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-b994n" event={"ID":"19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3","Type":"ContainerDied","Data":"073599e2747a52cdaebd2b16b156f8da5c4252fc040c0348baa95ddb64a5131f"} Jul 07 14:37:11.129541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.129212 2564 scope.go:117] "RemoveContainer" containerID="0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b" Jul 07 14:37:11.129833 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.129804 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:11.131209 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.131184 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678wm46c" Jul 07 14:37:11.175421 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.175357 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b994n"] Jul 07 14:37:11.180282 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.180250 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-b994n"] Jul 07 14:37:11.192826 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.192792 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8"] Jul 07 14:37:11.217582 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.217563 2564 scope.go:117] "RemoveContainer" containerID="0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b" Jul 07 14:37:11.217931 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:37:11.217903 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b\": container with ID starting with 0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b not found: ID does not exist" containerID="0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b" Jul 07 14:37:11.218024 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.217954 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b"} err="failed to get container status \"0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b\": rpc error: code = NotFound desc = could not find container \"0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b\": container with ID starting with 0b32f07fd3fcf67e28cc8e18e0c5f45e4e46e79a2b1c8521f029b45125f5da8b not found: ID does not exist" Jul 07 14:37:11.689969 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.689913 2564 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-ddnm8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body= Jul 07 14:37:11.690138 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:11.690002 2564 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" Jul 07 14:37:12.135669 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:12.135634 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" containerName="istio-proxy" containerID="cri-o://a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f" gracePeriod=30 Jul 07 14:37:12.502707 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:12.502674 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" path="/var/lib/kubelet/pods/19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3/volumes" Jul 07 14:37:14.147091 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:14.147058 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" event={"ID":"fa910f89-bc15-409e-a179-3dcf5c1abcda","Type":"ContainerStarted","Data":"67db6984ff2ce234a76a1fea41cf505d3453d6e2f1b5adcc0eb6da5e20a1008b"} Jul 07 14:37:14.147540 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:14.147209 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:14.187669 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:14.187606 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" podStartSLOduration=2.888724978 podStartE2EDuration="6.187588027s" totalImagesPullingTime="3.298863049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:37:14.186423518 +0000 UTC m=+396.369170390" watchObservedRunningTime="2026-07-07 14:37:14.187588027 +0000 UTC m=+396.370334902" Jul 07 14:37:16.089870 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:16.089841 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-zrq9p" Jul 07 14:37:16.092220 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:16.092199 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-xckvx" Jul 07 14:37:17.383003 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.382974 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:17.411681 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411580 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a91899a-405f-439b-9da4-8c16dca3c433-istiod-ca-cert\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411681 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411631 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-data\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411681 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411670 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-credential-socket\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411742 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-certs\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411789 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a91899a-405f-439b-9da4-8c16dca3c433-istio-podinfo\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411815 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-socket\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411845 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f52m8\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-kube-api-access-f52m8\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411876 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-istio-token\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.411979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.411914 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-envoy\") pod \"0a91899a-405f-439b-9da4-8c16dca3c433\" (UID: \"0a91899a-405f-439b-9da4-8c16dca3c433\") " Jul 07 14:37:17.412265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412004 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:37:17.412265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412032 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:37:17.412265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412046 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a91899a-405f-439b-9da4-8c16dca3c433-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:37:17.412265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412207 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:37:17.412464 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412316 2564 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-socket\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.412464 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412335 2564 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a91899a-405f-439b-9da4-8c16dca3c433-istiod-ca-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.412464 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412339 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:37:17.412464 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412349 2564 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-data\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.412464 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.412363 2564 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-credential-socket\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.414648 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.414603 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-kube-api-access-f52m8" (OuterVolumeSpecName: "kube-api-access-f52m8") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "kube-api-access-f52m8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:37:17.414797 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.414697 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:37:17.414881 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.414797 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:37:17.415760 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.415726 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a91899a-405f-439b-9da4-8c16dca3c433-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a91899a-405f-439b-9da4-8c16dca3c433" (UID: "0a91899a-405f-439b-9da4-8c16dca3c433"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 07 14:37:17.513645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.513602 2564 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-workload-certs\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.513645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.513633 2564 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a91899a-405f-439b-9da4-8c16dca3c433-istio-podinfo\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.513645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.513641 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f52m8\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-kube-api-access-f52m8\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.513645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.513651 2564 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a91899a-405f-439b-9da4-8c16dca3c433-istio-token\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:17.513645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:17.513659 2564 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a91899a-405f-439b-9da4-8c16dca3c433-istio-envoy\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:37:18.168697 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.168661 2564 generic.go:356] "Generic (PLEG): container finished" podID="0a91899a-405f-439b-9da4-8c16dca3c433" containerID="a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f" exitCode=0 Jul 07 14:37:18.168916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.168716 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" Jul 07 14:37:18.168916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.168730 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" event={"ID":"0a91899a-405f-439b-9da4-8c16dca3c433","Type":"ContainerDied","Data":"a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f"} Jul 07 14:37:18.168916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.168795 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8" event={"ID":"0a91899a-405f-439b-9da4-8c16dca3c433","Type":"ContainerDied","Data":"6a8c7d0ee06d6c6df4d4f61538bb14d71fa03fd1740796e254d50a876fa3c4a4"} Jul 07 14:37:18.168916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.168822 2564 scope.go:117] "RemoveContainer" containerID="a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f" Jul 07 14:37:18.178001 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.177984 2564 scope.go:117] "RemoveContainer" containerID="a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f" Jul 07 14:37:18.178283 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:37:18.178262 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f\": container with ID starting with a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f not found: ID does not exist" containerID="a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f" Jul 07 14:37:18.178343 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.178291 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f"} err="failed to get container status \"a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f\": rpc error: code = NotFound desc = could not find container \"a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f\": container with ID starting with a158c87bf0834874309b8d9bf9b5a04604b9f7fe7d9cc6aa9152b19d80a2327f not found: ID does not exist" Jul 07 14:37:18.190668 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.190634 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8"] Jul 07 14:37:18.194781 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.194757 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-ddnm8"] Jul 07 14:37:18.502202 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:18.502167 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" path="/var/lib/kubelet/pods/0a91899a-405f-439b-9da4-8c16dca3c433/volumes" Jul 07 14:37:45.154959 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:45.154919 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-8fmlz" Jul 07 14:37:58.451602 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.451561 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x7fnr"] Jul 07 14:37:58.452127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.452017 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" containerName="discovery" Jul 07 14:37:58.452127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.452036 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" containerName="discovery" Jul 07 14:37:58.452127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.452064 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" containerName="istio-proxy" Jul 07 14:37:58.452127 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.452071 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" containerName="istio-proxy" Jul 07 14:37:58.452324 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.452150 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a91899a-405f-439b-9da4-8c16dca3c433" containerName="istio-proxy" Jul 07 14:37:58.452324 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.452165 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="19dd10cb-16c7-4e9a-b6c6-0cb6b4895fc3" containerName="discovery" Jul 07 14:37:58.464177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.464134 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x7fnr"] Jul 07 14:37:58.464177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.464182 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:37:58.466702 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.466674 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 07 14:37:58.466906 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.466777 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 07 14:37:58.467656 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.467639 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-9bkqq\"" Jul 07 14:37:58.468229 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.468204 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcqbf\" (UniqueName: \"kubernetes.io/projected/23f07b8b-f3d9-47d6-9cb9-bd248a75808f-kube-api-access-mcqbf\") pod \"kuadrant-operator-catalog-x7fnr\" (UID: \"23f07b8b-f3d9-47d6-9cb9-bd248a75808f\") " pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:37:58.569080 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.569041 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mcqbf\" (UniqueName: \"kubernetes.io/projected/23f07b8b-f3d9-47d6-9cb9-bd248a75808f-kube-api-access-mcqbf\") pod \"kuadrant-operator-catalog-x7fnr\" (UID: \"23f07b8b-f3d9-47d6-9cb9-bd248a75808f\") " pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:37:58.578286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.578256 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcqbf\" (UniqueName: \"kubernetes.io/projected/23f07b8b-f3d9-47d6-9cb9-bd248a75808f-kube-api-access-mcqbf\") pod \"kuadrant-operator-catalog-x7fnr\" (UID: \"23f07b8b-f3d9-47d6-9cb9-bd248a75808f\") " pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:37:58.776807 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.776770 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:37:58.818157 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.818115 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x7fnr"] Jul 07 14:37:58.921485 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:58.921457 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x7fnr"] Jul 07 14:37:58.922592 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:37:58.922566 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23f07b8b_f3d9_47d6_9cb9_bd248a75808f.slice/crio-fe5d02ccb7b070e6147ecab620b16ae28630ddc1cac9d595d74e03504df16ccb WatchSource:0}: Error finding container fe5d02ccb7b070e6147ecab620b16ae28630ddc1cac9d595d74e03504df16ccb: Status 404 returned error can't find the container with id fe5d02ccb7b070e6147ecab620b16ae28630ddc1cac9d595d74e03504df16ccb Jul 07 14:37:59.028800 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.028722 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4khdg"] Jul 07 14:37:59.031957 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.031921 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:37:59.041460 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.041433 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4khdg"] Jul 07 14:37:59.073056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.073018 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-672v6\" (UniqueName: \"kubernetes.io/projected/38aaafc5-471f-4ab3-acba-e01bceebf5e6-kube-api-access-672v6\") pod \"kuadrant-operator-catalog-4khdg\" (UID: \"38aaafc5-471f-4ab3-acba-e01bceebf5e6\") " pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:37:59.173655 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.173625 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-672v6\" (UniqueName: \"kubernetes.io/projected/38aaafc5-471f-4ab3-acba-e01bceebf5e6-kube-api-access-672v6\") pod \"kuadrant-operator-catalog-4khdg\" (UID: \"38aaafc5-471f-4ab3-acba-e01bceebf5e6\") " pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:37:59.186406 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.186372 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-672v6\" (UniqueName: \"kubernetes.io/projected/38aaafc5-471f-4ab3-acba-e01bceebf5e6-kube-api-access-672v6\") pod \"kuadrant-operator-catalog-4khdg\" (UID: \"38aaafc5-471f-4ab3-acba-e01bceebf5e6\") " pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:37:59.342438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.342294 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:37:59.351772 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.351746 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" event={"ID":"23f07b8b-f3d9-47d6-9cb9-bd248a75808f","Type":"ContainerStarted","Data":"fe5d02ccb7b070e6147ecab620b16ae28630ddc1cac9d595d74e03504df16ccb"} Jul 07 14:37:59.480068 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:37:59.480030 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-4khdg"] Jul 07 14:37:59.502987 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:37:59.502913 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38aaafc5_471f_4ab3_acba_e01bceebf5e6.slice/crio-870ca47d480536ca91024b01a367207c21ee52916eba1ba74d104cd09f1b1b4b WatchSource:0}: Error finding container 870ca47d480536ca91024b01a367207c21ee52916eba1ba74d104cd09f1b1b4b: Status 404 returned error can't find the container with id 870ca47d480536ca91024b01a367207c21ee52916eba1ba74d104cd09f1b1b4b Jul 07 14:38:00.358197 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:00.358161 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" event={"ID":"38aaafc5-471f-4ab3-acba-e01bceebf5e6","Type":"ContainerStarted","Data":"870ca47d480536ca91024b01a367207c21ee52916eba1ba74d104cd09f1b1b4b"} Jul 07 14:38:01.364642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.364602 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" event={"ID":"23f07b8b-f3d9-47d6-9cb9-bd248a75808f","Type":"ContainerStarted","Data":"7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6"} Jul 07 14:38:01.365105 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.364694 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" podUID="23f07b8b-f3d9-47d6-9cb9-bd248a75808f" containerName="registry-server" containerID="cri-o://7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6" gracePeriod=2 Jul 07 14:38:01.366219 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.366190 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" event={"ID":"38aaafc5-471f-4ab3-acba-e01bceebf5e6","Type":"ContainerStarted","Data":"ac15fa1335868df198d67fa38e57f20633119be392981ae6c4c11910fc98ba28"} Jul 07 14:38:01.381434 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.381379 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" podStartSLOduration=1.40975345 podStartE2EDuration="3.381357389s" totalImagesPullingTime="1.971603939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:01.381160732 +0000 UTC m=+443.563907604" watchObservedRunningTime="2026-07-07 14:38:01.381357389 +0000 UTC m=+443.564104261" Jul 07 14:38:01.397134 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.397084 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" podStartSLOduration=1.0029686 podStartE2EDuration="2.397066026s" totalImagesPullingTime="1.394097426s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:37:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:01.395896554 +0000 UTC m=+443.578643427" watchObservedRunningTime="2026-07-07 14:38:01.397066026 +0000 UTC m=+443.579813046" Jul 07 14:38:01.611573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.611541 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:38:01.696479 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.696390 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mcqbf\" (UniqueName: \"kubernetes.io/projected/23f07b8b-f3d9-47d6-9cb9-bd248a75808f-kube-api-access-mcqbf\") pod \"23f07b8b-f3d9-47d6-9cb9-bd248a75808f\" (UID: \"23f07b8b-f3d9-47d6-9cb9-bd248a75808f\") " Jul 07 14:38:01.698502 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.698469 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23f07b8b-f3d9-47d6-9cb9-bd248a75808f-kube-api-access-mcqbf" (OuterVolumeSpecName: "kube-api-access-mcqbf") pod "23f07b8b-f3d9-47d6-9cb9-bd248a75808f" (UID: "23f07b8b-f3d9-47d6-9cb9-bd248a75808f"). InnerVolumeSpecName "kube-api-access-mcqbf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:38:01.797263 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:01.797225 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mcqbf\" (UniqueName: \"kubernetes.io/projected/23f07b8b-f3d9-47d6-9cb9-bd248a75808f-kube-api-access-mcqbf\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:02.371987 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.371930 2564 generic.go:356] "Generic (PLEG): container finished" podID="23f07b8b-f3d9-47d6-9cb9-bd248a75808f" containerID="7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6" exitCode=0 Jul 07 14:38:02.371987 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.371991 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" Jul 07 14:38:02.372449 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.372011 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" event={"ID":"23f07b8b-f3d9-47d6-9cb9-bd248a75808f","Type":"ContainerDied","Data":"7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6"} Jul 07 14:38:02.372449 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.372060 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x7fnr" event={"ID":"23f07b8b-f3d9-47d6-9cb9-bd248a75808f","Type":"ContainerDied","Data":"fe5d02ccb7b070e6147ecab620b16ae28630ddc1cac9d595d74e03504df16ccb"} Jul 07 14:38:02.372449 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.372081 2564 scope.go:117] "RemoveContainer" containerID="7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6" Jul 07 14:38:02.381347 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.381329 2564 scope.go:117] "RemoveContainer" containerID="7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6" Jul 07 14:38:02.381645 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:02.381621 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6\": container with ID starting with 7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6 not found: ID does not exist" containerID="7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6" Jul 07 14:38:02.381720 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.381654 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6"} err="failed to get container status \"7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6\": rpc error: code = NotFound desc = could not find container \"7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6\": container with ID starting with 7c5f5ec68a8066e27c12521fccea1e95fd0d283a4fff8d931f1aa5c440d00ac6 not found: ID does not exist" Jul 07 14:38:02.395251 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.395205 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x7fnr"] Jul 07 14:38:02.399961 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.399923 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x7fnr"] Jul 07 14:38:02.501780 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:02.501746 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23f07b8b-f3d9-47d6-9cb9-bd248a75808f" path="/var/lib/kubelet/pods/23f07b8b-f3d9-47d6-9cb9-bd248a75808f/volumes" Jul 07 14:38:09.342416 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:09.342372 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:38:09.343029 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:09.342484 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:38:09.365204 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:09.365175 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:38:09.427064 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:09.427034 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-4khdg" Jul 07 14:38:11.881183 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.881153 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8"] Jul 07 14:38:11.881594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.881465 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23f07b8b-f3d9-47d6-9cb9-bd248a75808f" containerName="registry-server" Jul 07 14:38:11.881594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.881476 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="23f07b8b-f3d9-47d6-9cb9-bd248a75808f" containerName="registry-server" Jul 07 14:38:11.881594 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.881534 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="23f07b8b-f3d9-47d6-9cb9-bd248a75808f" containerName="registry-server" Jul 07 14:38:11.884733 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.884708 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:11.887114 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.887095 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bj8n5\"" Jul 07 14:38:11.893112 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.893087 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8"] Jul 07 14:38:11.985785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.985744 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:11.986001 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.985805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h98b2\" (UniqueName: \"kubernetes.io/projected/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-kube-api-access-h98b2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:11.986001 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:11.985857 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.086690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.086644 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.086893 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.086702 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h98b2\" (UniqueName: \"kubernetes.io/projected/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-kube-api-access-h98b2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.086893 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.086740 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.087087 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.087066 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.087142 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.087121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.095315 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.095287 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h98b2\" (UniqueName: \"kubernetes.io/projected/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-kube-api-access-h98b2\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.194193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.194096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:12.340105 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.340075 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8"] Jul 07 14:38:12.343309 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:12.343276 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ceb0a26_f8b0_4bb4_96e2_aca640fb7cfb.slice/crio-b353c35f34eeb79d5973148d6269e7f1ef2d4e660411d0214be8a8bcf4a226ef WatchSource:0}: Error finding container b353c35f34eeb79d5973148d6269e7f1ef2d4e660411d0214be8a8bcf4a226ef: Status 404 returned error can't find the container with id b353c35f34eeb79d5973148d6269e7f1ef2d4e660411d0214be8a8bcf4a226ef Jul 07 14:38:12.421559 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.421519 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" event={"ID":"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb","Type":"ContainerStarted","Data":"eb887cee9db7ed12a66924d6f3f491914ae9d9130f4b0c2d8026a4c617fca265"} Jul 07 14:38:12.421721 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.421586 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" event={"ID":"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb","Type":"ContainerStarted","Data":"b353c35f34eeb79d5973148d6269e7f1ef2d4e660411d0214be8a8bcf4a226ef"} Jul 07 14:38:12.564520 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.564482 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck"] Jul 07 14:38:12.567476 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.567450 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.580428 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.580398 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck"] Jul 07 14:38:12.692630 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.692595 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.692630 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.692632 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.692836 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.692704 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbkxm\" (UniqueName: \"kubernetes.io/projected/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-kube-api-access-zbkxm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.793932 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.793894 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.793932 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.793931 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.794168 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.794000 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbkxm\" (UniqueName: \"kubernetes.io/projected/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-kube-api-access-zbkxm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.794327 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.794306 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.794363 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.794324 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.803572 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.803544 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbkxm\" (UniqueName: \"kubernetes.io/projected/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-kube-api-access-zbkxm\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:12.876597 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:12.876558 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:13.011187 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.011161 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck"] Jul 07 14:38:13.013581 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:13.013544 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffcd7a6c_ce56_41b8_a5f9_c64a55566185.slice/crio-506866c1bd83fb7106ced67f067b886b6773be61865059e78b6f03351d00112a WatchSource:0}: Error finding container 506866c1bd83fb7106ced67f067b886b6773be61865059e78b6f03351d00112a: Status 404 returned error can't find the container with id 506866c1bd83fb7106ced67f067b886b6773be61865059e78b6f03351d00112a Jul 07 14:38:13.082309 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.082274 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k"] Jul 07 14:38:13.085354 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.085335 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.096715 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.096675 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k"] Jul 07 14:38:13.198207 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.198159 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.198405 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.198220 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.198405 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.198307 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbw2k\" (UniqueName: \"kubernetes.io/projected/219060cf-c9af-452b-9cc7-639c101f6c4b-kube-api-access-gbw2k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.299439 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.299337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.299439 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.299401 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.299629 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.299443 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbw2k\" (UniqueName: \"kubernetes.io/projected/219060cf-c9af-452b-9cc7-639c101f6c4b-kube-api-access-gbw2k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.299790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.299766 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.299832 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.299770 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.308480 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.308451 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbw2k\" (UniqueName: \"kubernetes.io/projected/219060cf-c9af-452b-9cc7-639c101f6c4b-kube-api-access-gbw2k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.395782 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.395744 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:13.428351 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.428314 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerID="eb887cee9db7ed12a66924d6f3f491914ae9d9130f4b0c2d8026a4c617fca265" exitCode=0 Jul 07 14:38:13.428526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.428391 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" event={"ID":"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb","Type":"ContainerDied","Data":"eb887cee9db7ed12a66924d6f3f491914ae9d9130f4b0c2d8026a4c617fca265"} Jul 07 14:38:13.430168 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.430145 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerID="c6a95415229c4028d063941deb1717423f5e1da8ea3631fef33b32b668941f3d" exitCode=0 Jul 07 14:38:13.430327 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.430199 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" event={"ID":"ffcd7a6c-ce56-41b8-a5f9-c64a55566185","Type":"ContainerDied","Data":"c6a95415229c4028d063941deb1717423f5e1da8ea3631fef33b32b668941f3d"} Jul 07 14:38:13.430327 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.430248 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" event={"ID":"ffcd7a6c-ce56-41b8-a5f9-c64a55566185","Type":"ContainerStarted","Data":"506866c1bd83fb7106ced67f067b886b6773be61865059e78b6f03351d00112a"} Jul 07 14:38:13.537203 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.537169 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k"] Jul 07 14:38:13.540652 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:13.540616 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod219060cf_c9af_452b_9cc7_639c101f6c4b.slice/crio-36ef6e32ec9235374c92ca910f7285695da683b279b10b97ea63524c2a1fd999 WatchSource:0}: Error finding container 36ef6e32ec9235374c92ca910f7285695da683b279b10b97ea63524c2a1fd999: Status 404 returned error can't find the container with id 36ef6e32ec9235374c92ca910f7285695da683b279b10b97ea63524c2a1fd999 Jul 07 14:38:13.686215 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.686186 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6"] Jul 07 14:38:13.688790 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.688775 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.698060 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.698032 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6"] Jul 07 14:38:13.804656 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.804568 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.804656 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.804625 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.804839 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.804676 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrjjf\" (UniqueName: \"kubernetes.io/projected/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-kube-api-access-mrjjf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.905370 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.905325 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.905556 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.905416 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.905556 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.905457 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrjjf\" (UniqueName: \"kubernetes.io/projected/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-kube-api-access-mrjjf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.905730 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.905710 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.905839 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.905817 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.915236 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.915197 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrjjf\" (UniqueName: \"kubernetes.io/projected/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-kube-api-access-mrjjf\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:13.998075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:13.998046 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:14.138655 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.138628 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6"] Jul 07 14:38:14.140517 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:14.140488 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode749ffaa_8f18_4a75_a21e_fe71e5c45b9d.slice/crio-b7bc16fb909b00a6a7e2c27965548c2e3c043aa5fc22218d7ab93e6faf38d84f WatchSource:0}: Error finding container b7bc16fb909b00a6a7e2c27965548c2e3c043aa5fc22218d7ab93e6faf38d84f: Status 404 returned error can't find the container with id b7bc16fb909b00a6a7e2c27965548c2e3c043aa5fc22218d7ab93e6faf38d84f Jul 07 14:38:14.437287 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.437192 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerID="03e1d69429baaa58d1200adab9fd011a838dd43ca10cd6f431bdae7e06b7fc4b" exitCode=0 Jul 07 14:38:14.437469 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.437279 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" event={"ID":"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb","Type":"ContainerDied","Data":"03e1d69429baaa58d1200adab9fd011a838dd43ca10cd6f431bdae7e06b7fc4b"} Jul 07 14:38:14.438978 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.438958 2564 generic.go:356] "Generic (PLEG): container finished" podID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerID="b771602fd38a56861e9482024db5cc00ecb8084451eba0812c9c50b667933cc9" exitCode=0 Jul 07 14:38:14.439046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.438990 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" event={"ID":"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d","Type":"ContainerDied","Data":"b771602fd38a56861e9482024db5cc00ecb8084451eba0812c9c50b667933cc9"} Jul 07 14:38:14.439046 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.439028 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" event={"ID":"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d","Type":"ContainerStarted","Data":"b7bc16fb909b00a6a7e2c27965548c2e3c043aa5fc22218d7ab93e6faf38d84f"} Jul 07 14:38:14.440665 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.440642 2564 generic.go:356] "Generic (PLEG): container finished" podID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerID="acd363537417e60770440fd0f532e5a264154aa950b8386cc77ed83446f80789" exitCode=0 Jul 07 14:38:14.440762 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.440737 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" event={"ID":"219060cf-c9af-452b-9cc7-639c101f6c4b","Type":"ContainerDied","Data":"acd363537417e60770440fd0f532e5a264154aa950b8386cc77ed83446f80789"} Jul 07 14:38:14.440823 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:14.440773 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" event={"ID":"219060cf-c9af-452b-9cc7-639c101f6c4b","Type":"ContainerStarted","Data":"36ef6e32ec9235374c92ca910f7285695da683b279b10b97ea63524c2a1fd999"} Jul 07 14:38:15.448694 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:15.448659 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" event={"ID":"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d","Type":"ContainerStarted","Data":"c57ff2ddc09c2c79fc330aa9c06af4ba59e888a5aca6e793057cc38a80651b38"} Jul 07 14:38:15.450693 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:15.450668 2564 generic.go:356] "Generic (PLEG): container finished" podID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerID="16f67ac71f0f66794c29d5c3004ca218675908cbf747f516b80d9144f74da939" exitCode=0 Jul 07 14:38:15.450794 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:15.450748 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" event={"ID":"219060cf-c9af-452b-9cc7-639c101f6c4b","Type":"ContainerDied","Data":"16f67ac71f0f66794c29d5c3004ca218675908cbf747f516b80d9144f74da939"} Jul 07 14:38:15.453541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:15.453514 2564 generic.go:356] "Generic (PLEG): container finished" podID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerID="45f41ca80bb7d0085b622cba691780e05fa58a55510355a93eb681d166c861c1" exitCode=0 Jul 07 14:38:15.453650 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:15.453573 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" event={"ID":"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb","Type":"ContainerDied","Data":"45f41ca80bb7d0085b622cba691780e05fa58a55510355a93eb681d166c861c1"} Jul 07 14:38:16.460305 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.460272 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerID="59ce783b200c4cbb2cee36d45b973a7e9c46c858c3a0fcc1d29975ccfa35484c" exitCode=0 Jul 07 14:38:16.460742 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.460349 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" event={"ID":"ffcd7a6c-ce56-41b8-a5f9-c64a55566185","Type":"ContainerDied","Data":"59ce783b200c4cbb2cee36d45b973a7e9c46c858c3a0fcc1d29975ccfa35484c"} Jul 07 14:38:16.462377 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.462343 2564 generic.go:356] "Generic (PLEG): container finished" podID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerID="c57ff2ddc09c2c79fc330aa9c06af4ba59e888a5aca6e793057cc38a80651b38" exitCode=0 Jul 07 14:38:16.462459 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.462430 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" event={"ID":"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d","Type":"ContainerDied","Data":"c57ff2ddc09c2c79fc330aa9c06af4ba59e888a5aca6e793057cc38a80651b38"} Jul 07 14:38:16.464842 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.464820 2564 generic.go:356] "Generic (PLEG): container finished" podID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerID="1acf75a8d3f9484f77d9a98369612ded34f40ec92fd0ab63ab1faf431d682b2c" exitCode=0 Jul 07 14:38:16.464916 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.464866 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" event={"ID":"219060cf-c9af-452b-9cc7-639c101f6c4b","Type":"ContainerDied","Data":"1acf75a8d3f9484f77d9a98369612ded34f40ec92fd0ab63ab1faf431d682b2c"} Jul 07 14:38:16.611979 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.611928 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:16.730573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.730544 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-util\") pod \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " Jul 07 14:38:16.730763 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.730614 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-bundle\") pod \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " Jul 07 14:38:16.730763 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.730663 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h98b2\" (UniqueName: \"kubernetes.io/projected/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-kube-api-access-h98b2\") pod \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\" (UID: \"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb\") " Jul 07 14:38:16.731184 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.731162 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-bundle" (OuterVolumeSpecName: "bundle") pod "4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" (UID: "4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:16.732822 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.732795 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-kube-api-access-h98b2" (OuterVolumeSpecName: "kube-api-access-h98b2") pod "4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" (UID: "4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb"). InnerVolumeSpecName "kube-api-access-h98b2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:38:16.735526 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.735506 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-util" (OuterVolumeSpecName: "util") pod "4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" (UID: "4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:16.832056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.832017 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:16.832056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.832048 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:16.832056 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:16.832061 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h98b2\" (UniqueName: \"kubernetes.io/projected/4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb-kube-api-access-h98b2\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:17.472388 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.472360 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" Jul 07 14:38:17.472799 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.472394 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8" event={"ID":"4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb","Type":"ContainerDied","Data":"b353c35f34eeb79d5973148d6269e7f1ef2d4e660411d0214be8a8bcf4a226ef"} Jul 07 14:38:17.472799 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.472437 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b353c35f34eeb79d5973148d6269e7f1ef2d4e660411d0214be8a8bcf4a226ef" Jul 07 14:38:17.474567 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.474542 2564 generic.go:356] "Generic (PLEG): container finished" podID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerID="3bdaa6338d315cbfd2d16ea3db8596d008e76ae4c7a33f49d5ebadf23b83d568" exitCode=0 Jul 07 14:38:17.474681 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.474620 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" event={"ID":"ffcd7a6c-ce56-41b8-a5f9-c64a55566185","Type":"ContainerDied","Data":"3bdaa6338d315cbfd2d16ea3db8596d008e76ae4c7a33f49d5ebadf23b83d568"} Jul 07 14:38:17.476757 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.476723 2564 generic.go:356] "Generic (PLEG): container finished" podID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerID="2c45f5c5a23dce0dd5a35d943d22146df4085bf37691dc36dd10af671f53cb2f" exitCode=0 Jul 07 14:38:17.476862 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.476788 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" event={"ID":"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d","Type":"ContainerDied","Data":"2c45f5c5a23dce0dd5a35d943d22146df4085bf37691dc36dd10af671f53cb2f"} Jul 07 14:38:17.611044 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.611017 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:17.739438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.739334 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-bundle\") pod \"219060cf-c9af-452b-9cc7-639c101f6c4b\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " Jul 07 14:38:17.739438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.739381 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbw2k\" (UniqueName: \"kubernetes.io/projected/219060cf-c9af-452b-9cc7-639c101f6c4b-kube-api-access-gbw2k\") pod \"219060cf-c9af-452b-9cc7-639c101f6c4b\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " Jul 07 14:38:17.739438 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.739424 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-util\") pod \"219060cf-c9af-452b-9cc7-639c101f6c4b\" (UID: \"219060cf-c9af-452b-9cc7-639c101f6c4b\") " Jul 07 14:38:17.740011 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.739983 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-bundle" (OuterVolumeSpecName: "bundle") pod "219060cf-c9af-452b-9cc7-639c101f6c4b" (UID: "219060cf-c9af-452b-9cc7-639c101f6c4b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:17.741608 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.741580 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/219060cf-c9af-452b-9cc7-639c101f6c4b-kube-api-access-gbw2k" (OuterVolumeSpecName: "kube-api-access-gbw2k") pod "219060cf-c9af-452b-9cc7-639c101f6c4b" (UID: "219060cf-c9af-452b-9cc7-639c101f6c4b"). InnerVolumeSpecName "kube-api-access-gbw2k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:38:17.745557 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.745533 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-util" (OuterVolumeSpecName: "util") pod "219060cf-c9af-452b-9cc7-639c101f6c4b" (UID: "219060cf-c9af-452b-9cc7-639c101f6c4b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:17.840411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.840376 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbw2k\" (UniqueName: \"kubernetes.io/projected/219060cf-c9af-452b-9cc7-639c101f6c4b-kube-api-access-gbw2k\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:17.840411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.840406 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:17.840411 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:17.840414 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/219060cf-c9af-452b-9cc7-639c101f6c4b-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:18.483075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.483048 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" Jul 07 14:38:18.483460 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.483082 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k" event={"ID":"219060cf-c9af-452b-9cc7-639c101f6c4b","Type":"ContainerDied","Data":"36ef6e32ec9235374c92ca910f7285695da683b279b10b97ea63524c2a1fd999"} Jul 07 14:38:18.483460 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.483131 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="36ef6e32ec9235374c92ca910f7285695da683b279b10b97ea63524c2a1fd999" Jul 07 14:38:18.647875 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.647847 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:18.652541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.652520 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:18.749861 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.749773 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-bundle\") pod \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " Jul 07 14:38:18.749861 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.749824 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mrjjf\" (UniqueName: \"kubernetes.io/projected/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-kube-api-access-mrjjf\") pod \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " Jul 07 14:38:18.749861 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.749858 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-util\") pod \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\" (UID: \"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d\") " Jul 07 14:38:18.750177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.749889 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbkxm\" (UniqueName: \"kubernetes.io/projected/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-kube-api-access-zbkxm\") pod \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " Jul 07 14:38:18.750177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.749975 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-util\") pod \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " Jul 07 14:38:18.750177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.750015 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-bundle\") pod \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\" (UID: \"ffcd7a6c-ce56-41b8-a5f9-c64a55566185\") " Jul 07 14:38:18.750541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.750510 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-bundle" (OuterVolumeSpecName: "bundle") pod "e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" (UID: "e749ffaa-8f18-4a75-a21e-fe71e5c45b9d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:18.750650 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.750545 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-bundle" (OuterVolumeSpecName: "bundle") pod "ffcd7a6c-ce56-41b8-a5f9-c64a55566185" (UID: "ffcd7a6c-ce56-41b8-a5f9-c64a55566185"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:18.752240 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.752205 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-kube-api-access-zbkxm" (OuterVolumeSpecName: "kube-api-access-zbkxm") pod "ffcd7a6c-ce56-41b8-a5f9-c64a55566185" (UID: "ffcd7a6c-ce56-41b8-a5f9-c64a55566185"). InnerVolumeSpecName "kube-api-access-zbkxm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:38:18.752383 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.752367 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-kube-api-access-mrjjf" (OuterVolumeSpecName: "kube-api-access-mrjjf") pod "e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" (UID: "e749ffaa-8f18-4a75-a21e-fe71e5c45b9d"). InnerVolumeSpecName "kube-api-access-mrjjf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:38:18.755129 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.755099 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-util" (OuterVolumeSpecName: "util") pod "ffcd7a6c-ce56-41b8-a5f9-c64a55566185" (UID: "ffcd7a6c-ce56-41b8-a5f9-c64a55566185"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:18.756428 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.756406 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-util" (OuterVolumeSpecName: "util") pod "e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" (UID: "e749ffaa-8f18-4a75-a21e-fe71e5c45b9d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:38:18.850924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.850887 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:18.850924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.850918 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mrjjf\" (UniqueName: \"kubernetes.io/projected/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-kube-api-access-mrjjf\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:18.850924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.850927 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e749ffaa-8f18-4a75-a21e-fe71e5c45b9d-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:18.851183 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.850962 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbkxm\" (UniqueName: \"kubernetes.io/projected/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-kube-api-access-zbkxm\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:18.851183 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.850973 2564 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-util\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:18.851183 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:18.850981 2564 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffcd7a6c-ce56-41b8-a5f9-c64a55566185-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:38:19.489869 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:19.489840 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" Jul 07 14:38:19.490329 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:19.489831 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck" event={"ID":"ffcd7a6c-ce56-41b8-a5f9-c64a55566185","Type":"ContainerDied","Data":"506866c1bd83fb7106ced67f067b886b6773be61865059e78b6f03351d00112a"} Jul 07 14:38:19.490329 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:19.490026 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="506866c1bd83fb7106ced67f067b886b6773be61865059e78b6f03351d00112a" Jul 07 14:38:19.491921 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:19.491890 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" event={"ID":"e749ffaa-8f18-4a75-a21e-fe71e5c45b9d","Type":"ContainerDied","Data":"b7bc16fb909b00a6a7e2c27965548c2e3c043aa5fc22218d7ab93e6faf38d84f"} Jul 07 14:38:19.492060 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:19.491951 2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b7bc16fb909b00a6a7e2c27965548c2e3c043aa5fc22218d7ab93e6faf38d84f" Jul 07 14:38:19.492060 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:19.491899 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6" Jul 07 14:38:28.191467 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191425 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56cd85fb6f-phkrp"] Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191761 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="pull" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191772 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="pull" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191786 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="extract" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191791 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="extract" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191801 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="pull" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191807 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="pull" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191812 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="extract" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191818 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="extract" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191825 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="util" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191831 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="util" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191838 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="util" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191843 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="util" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191852 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="pull" Jul 07 14:38:28.191856 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191858 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="pull" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191865 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191871 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191876 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="pull" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191882 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="pull" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191887 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191892 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191899 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="util" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191921 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="util" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191931 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="util" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.191950 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="util" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.192002 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="e749ffaa-8f18-4a75-a21e-fe71e5c45b9d" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.192009 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffcd7a6c-ce56-41b8-a5f9-c64a55566185" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.192016 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="219060cf-c9af-452b-9cc7-639c101f6c4b" containerName="extract" Jul 07 14:38:28.192271 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.192021 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb" containerName="extract" Jul 07 14:38:28.194704 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.194684 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.223183 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.223143 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cd85fb6f-phkrp"] Jul 07 14:38:28.332370 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332330 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-config\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.332575 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332391 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-trusted-ca-bundle\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.332575 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-oauth-config\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.332575 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332541 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-service-ca\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.332575 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332558 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-oauth-serving-cert\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.332709 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332592 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-serving-cert\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.332709 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.332608 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgmfz\" (UniqueName: \"kubernetes.io/projected/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-kube-api-access-rgmfz\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433140 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-oauth-config\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433357 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433208 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-service-ca\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433357 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433232 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-oauth-serving-cert\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433357 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433277 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-serving-cert\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433357 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433305 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgmfz\" (UniqueName: \"kubernetes.io/projected/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-kube-api-access-rgmfz\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433357 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433337 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-config\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.433619 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433370 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-trusted-ca-bundle\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.434014 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.433989 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-service-ca\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.434189 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.434107 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-config\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.434478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.434459 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-oauth-serving-cert\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.434654 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.434621 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-trusted-ca-bundle\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.436153 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.436121 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-serving-cert\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.436236 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.436193 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-console-oauth-config\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.443719 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.443661 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgmfz\" (UniqueName: \"kubernetes.io/projected/bfbdd00f-f798-4959-bdbd-5ee0e0ee133b-kube-api-access-rgmfz\") pod \"console-56cd85fb6f-phkrp\" (UID: \"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b\") " pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.486506 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.486468 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6"] Jul 07 14:38:28.489854 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.489830 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:28.492002 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.491976 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 07 14:38:28.492002 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.491979 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-t7dgx\"" Jul 07 14:38:28.503550 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.503494 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:28.506667 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.506618 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6"] Jul 07 14:38:28.638507 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.638373 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8njg\" (UniqueName: \"kubernetes.io/projected/81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4-kube-api-access-j8njg\") pod \"dns-operator-controller-manager-864dd78c4c-2rcj6\" (UID: \"81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:28.681075 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.681048 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56cd85fb6f-phkrp"] Jul 07 14:38:28.684169 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:28.684139 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbdd00f_f798_4959_bdbd_5ee0e0ee133b.slice/crio-b208ccbcdb5998d8f016370a69d211b0523c0399f16bf37851048ad704c47491 WatchSource:0}: Error finding container b208ccbcdb5998d8f016370a69d211b0523c0399f16bf37851048ad704c47491: Status 404 returned error can't find the container with id b208ccbcdb5998d8f016370a69d211b0523c0399f16bf37851048ad704c47491 Jul 07 14:38:28.739930 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.739901 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8njg\" (UniqueName: \"kubernetes.io/projected/81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4-kube-api-access-j8njg\") pod \"dns-operator-controller-manager-864dd78c4c-2rcj6\" (UID: \"81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:28.755798 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.755761 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8njg\" (UniqueName: \"kubernetes.io/projected/81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4-kube-api-access-j8njg\") pod \"dns-operator-controller-manager-864dd78c4c-2rcj6\" (UID: \"81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:28.800632 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.800599 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:28.939559 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:28.939534 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6"] Jul 07 14:38:28.941756 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:28.941731 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81e0488b_e6bd_4a1e_8ecb_6f7e1df6fea4.slice/crio-88eed5b132973b3a7bc5dcc21466f1cbb65bd344b347845c3bf2722dfd8ff5d4 WatchSource:0}: Error finding container 88eed5b132973b3a7bc5dcc21466f1cbb65bd344b347845c3bf2722dfd8ff5d4: Status 404 returned error can't find the container with id 88eed5b132973b3a7bc5dcc21466f1cbb65bd344b347845c3bf2722dfd8ff5d4 Jul 07 14:38:29.547371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:29.547328 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cd85fb6f-phkrp" event={"ID":"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b","Type":"ContainerStarted","Data":"1b19744c6d8c0325ecd6d1dbaee8d8a41d685fed5a55f279e45b82d27a487e55"} Jul 07 14:38:29.547782 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:29.547388 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56cd85fb6f-phkrp" event={"ID":"bfbdd00f-f798-4959-bdbd-5ee0e0ee133b","Type":"ContainerStarted","Data":"b208ccbcdb5998d8f016370a69d211b0523c0399f16bf37851048ad704c47491"} Jul 07 14:38:29.548664 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:29.548644 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" event={"ID":"81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4","Type":"ContainerStarted","Data":"88eed5b132973b3a7bc5dcc21466f1cbb65bd344b347845c3bf2722dfd8ff5d4"} Jul 07 14:38:29.574425 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:29.574373 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56cd85fb6f-phkrp" podStartSLOduration=1.574356507 podStartE2EDuration="1.574356507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:29.571972452 +0000 UTC m=+471.754719319" watchObservedRunningTime="2026-07-07 14:38:29.574356507 +0000 UTC m=+471.757103377" Jul 07 14:38:31.562591 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:31.562552 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" event={"ID":"81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4","Type":"ContainerStarted","Data":"38f721a78d3a3c8068425fa2d52b85f30d2ffff193fc60a147dff8ee69f6cc7c"} Jul 07 14:38:31.563071 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:31.562655 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:31.584396 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:31.584336 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" podStartSLOduration=1.7239734 podStartE2EDuration="3.584318672s" totalImagesPullingTime="1.860345272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:31.582052922 +0000 UTC m=+473.764799793" watchObservedRunningTime="2026-07-07 14:38:31.584318672 +0000 UTC m=+473.767065541" Jul 07 14:38:33.421467 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.421428 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz"] Jul 07 14:38:33.429187 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.429155 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.431348 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.431324 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lsz98\"" Jul 07 14:38:33.439388 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.439352 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz"] Jul 07 14:38:33.582325 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.582293 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7tq6\" (UniqueName: \"kubernetes.io/projected/8175a60d-b026-4712-bf72-40d26821da7f-kube-api-access-v7tq6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.582504 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.582404 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8175a60d-b026-4712-bf72-40d26821da7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.683286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.683174 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8175a60d-b026-4712-bf72-40d26821da7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.683286 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.683262 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7tq6\" (UniqueName: \"kubernetes.io/projected/8175a60d-b026-4712-bf72-40d26821da7f-kube-api-access-v7tq6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.683640 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.683614 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8175a60d-b026-4712-bf72-40d26821da7f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.699138 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.699114 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7tq6\" (UniqueName: \"kubernetes.io/projected/8175a60d-b026-4712-bf72-40d26821da7f-kube-api-access-v7tq6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.740136 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.740096 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:33.911708 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:33.911682 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz"] Jul 07 14:38:33.913877 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:33.913852 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8175a60d_b026_4712_bf72_40d26821da7f.slice/crio-ca2b1c8242597445ab0048fd72c5d66f2a05b513cc41859c16e29e160a2e2cb6 WatchSource:0}: Error finding container ca2b1c8242597445ab0048fd72c5d66f2a05b513cc41859c16e29e160a2e2cb6: Status 404 returned error can't find the container with id ca2b1c8242597445ab0048fd72c5d66f2a05b513cc41859c16e29e160a2e2cb6 Jul 07 14:38:34.578645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:34.578603 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" event={"ID":"8175a60d-b026-4712-bf72-40d26821da7f","Type":"ContainerStarted","Data":"ca2b1c8242597445ab0048fd72c5d66f2a05b513cc41859c16e29e160a2e2cb6"} Jul 07 14:38:37.272484 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.272446 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf"] Jul 07 14:38:37.275997 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.275978 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:37.278341 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.278314 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-b2w76\"" Jul 07 14:38:37.285087 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.285062 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf"] Jul 07 14:38:37.419062 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.419022 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgc9g\" (UniqueName: \"kubernetes.io/projected/8ee04844-37db-4a7a-8611-be70f4d3ac89-kube-api-access-vgc9g\") pod \"authorino-operator-75cc8d5cb7-gdjtf\" (UID: \"8ee04844-37db-4a7a-8611-be70f4d3ac89\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:37.521450 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.521405 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgc9g\" (UniqueName: \"kubernetes.io/projected/8ee04844-37db-4a7a-8611-be70f4d3ac89-kube-api-access-vgc9g\") pod \"authorino-operator-75cc8d5cb7-gdjtf\" (UID: \"8ee04844-37db-4a7a-8611-be70f4d3ac89\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:37.539159 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.539086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgc9g\" (UniqueName: \"kubernetes.io/projected/8ee04844-37db-4a7a-8611-be70f4d3ac89-kube-api-access-vgc9g\") pod \"authorino-operator-75cc8d5cb7-gdjtf\" (UID: \"8ee04844-37db-4a7a-8611-be70f4d3ac89\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:37.588236 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.588156 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:37.800638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:37.797776 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf"] Jul 07 14:38:37.807428 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:37.807396 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee04844_37db_4a7a_8611_be70f4d3ac89.slice/crio-d86eef0b647e7b33aa963e8ab1417a0f5be5b0c016e5f746e78b9a27835223fd WatchSource:0}: Error finding container d86eef0b647e7b33aa963e8ab1417a0f5be5b0c016e5f746e78b9a27835223fd: Status 404 returned error can't find the container with id d86eef0b647e7b33aa963e8ab1417a0f5be5b0c016e5f746e78b9a27835223fd Jul 07 14:38:38.507514 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:38.507065 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:38.507514 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:38.507129 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:38.510788 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:38.510765 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:38.604315 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:38.604217 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" event={"ID":"8ee04844-37db-4a7a-8611-be70f4d3ac89","Type":"ContainerStarted","Data":"d86eef0b647e7b33aa963e8ab1417a0f5be5b0c016e5f746e78b9a27835223fd"} Jul 07 14:38:38.608765 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:38.608736 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56cd85fb6f-phkrp" Jul 07 14:38:38.677332 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:38.677295 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fdd98b4d6-bf8sp"] Jul 07 14:38:39.614050 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:39.613962 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" event={"ID":"8175a60d-b026-4712-bf72-40d26821da7f","Type":"ContainerStarted","Data":"3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c"} Jul 07 14:38:39.645326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:39.644652 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" podStartSLOduration=1.308368376 podStartE2EDuration="6.644631961s" totalImagesPullingTime="5.336263585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:39.642791039 +0000 UTC m=+481.825537935" watchObservedRunningTime="2026-07-07 14:38:39.644631961 +0000 UTC m=+481.827378833" Jul 07 14:38:40.163323 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.163255 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4"] Jul 07 14:38:40.172883 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.172851 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:40.176013 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.175983 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-4rtkr\"" Jul 07 14:38:40.178702 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.178671 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4"] Jul 07 14:38:40.248613 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.248569 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr5jd\" (UniqueName: \"kubernetes.io/projected/b3ca751a-5a01-4589-82f0-d926236a29b7-kube-api-access-kr5jd\") pod \"limitador-operator-controller-manager-859d7b78bd-prmh4\" (UID: \"b3ca751a-5a01-4589-82f0-d926236a29b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:40.349865 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.349830 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr5jd\" (UniqueName: \"kubernetes.io/projected/b3ca751a-5a01-4589-82f0-d926236a29b7-kube-api-access-kr5jd\") pod \"limitador-operator-controller-manager-859d7b78bd-prmh4\" (UID: \"b3ca751a-5a01-4589-82f0-d926236a29b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:40.358256 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.358224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr5jd\" (UniqueName: \"kubernetes.io/projected/b3ca751a-5a01-4589-82f0-d926236a29b7-kube-api-access-kr5jd\") pod \"limitador-operator-controller-manager-859d7b78bd-prmh4\" (UID: \"b3ca751a-5a01-4589-82f0-d926236a29b7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:40.488575 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.488545 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:40.621778 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:40.621743 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:41.115887 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:41.115839 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4"] Jul 07 14:38:41.119382 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:41.119348 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ca751a_5a01_4589_82f0_d926236a29b7.slice/crio-487ed62e8240e04aef8ae798e342defb348a06922e80fe9c82d9688faf103187 WatchSource:0}: Error finding container 487ed62e8240e04aef8ae798e342defb348a06922e80fe9c82d9688faf103187: Status 404 returned error can't find the container with id 487ed62e8240e04aef8ae798e342defb348a06922e80fe9c82d9688faf103187 Jul 07 14:38:41.630298 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:41.630239 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" event={"ID":"8ee04844-37db-4a7a-8611-be70f4d3ac89","Type":"ContainerStarted","Data":"365557947f87d7bd9a85c68dfa5ede039559a1db8dd419e5deebfacd0bf47155"} Jul 07 14:38:41.630786 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:41.630404 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:41.631573 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:41.631548 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" event={"ID":"b3ca751a-5a01-4589-82f0-d926236a29b7","Type":"ContainerStarted","Data":"487ed62e8240e04aef8ae798e342defb348a06922e80fe9c82d9688faf103187"} Jul 07 14:38:41.650722 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:41.650660 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" podStartSLOduration=1.433520908 podStartE2EDuration="4.65064204s" totalImagesPullingTime="3.217121132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:41.649199776 +0000 UTC m=+483.831946647" watchObservedRunningTime="2026-07-07 14:38:41.65064204 +0000 UTC m=+483.833388965" Jul 07 14:38:42.266768 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.266731 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc"] Jul 07 14:38:42.270222 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.270196 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.272393 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.272365 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 07 14:38:42.272393 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.272389 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-bj8n5\"" Jul 07 14:38:42.272564 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.272503 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 07 14:38:42.277829 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.277803 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc"] Jul 07 14:38:42.365737 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.365695 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.365905 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.365781 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpkzk\" (UniqueName: \"kubernetes.io/projected/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-kube-api-access-tpkzk\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.365988 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.365902 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.466465 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.466420 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpkzk\" (UniqueName: \"kubernetes.io/projected/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-kube-api-access-tpkzk\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.466654 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.466549 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.466654 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.466591 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.467371 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.467341 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.469711 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.469662 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.475690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.475639 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpkzk\" (UniqueName: \"kubernetes.io/projected/a89b5f2b-7dcb-4b29-aecc-abedc7d34539-kube-api-access-tpkzk\") pod \"kuadrant-console-plugin-66b5774985-6h4sc\" (UID: \"a89b5f2b-7dcb-4b29-aecc-abedc7d34539\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.569892 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.569797 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2rcj6" Jul 07 14:38:42.582359 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.582330 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" Jul 07 14:38:42.960299 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:42.960276 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc"] Jul 07 14:38:42.961629 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:38:42.961606 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda89b5f2b_7dcb_4b29_aecc_abedc7d34539.slice/crio-afd39f05ba13be721cf5f4785d4b55e4c82752075c37f93c1165b994bd69dcb9 WatchSource:0}: Error finding container afd39f05ba13be721cf5f4785d4b55e4c82752075c37f93c1165b994bd69dcb9: Status 404 returned error can't find the container with id afd39f05ba13be721cf5f4785d4b55e4c82752075c37f93c1165b994bd69dcb9 Jul 07 14:38:43.646161 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:43.646109 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" event={"ID":"a89b5f2b-7dcb-4b29-aecc-abedc7d34539","Type":"ContainerStarted","Data":"afd39f05ba13be721cf5f4785d4b55e4c82752075c37f93c1165b994bd69dcb9"} Jul 07 14:38:43.648014 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:43.647981 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" event={"ID":"b3ca751a-5a01-4589-82f0-d926236a29b7","Type":"ContainerStarted","Data":"23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d"} Jul 07 14:38:43.648177 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:43.648039 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:43.667108 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:43.667054 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" podStartSLOduration=1.918449692 podStartE2EDuration="3.667030867s" totalImagesPullingTime="1.748581175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:38:43.665600593 +0000 UTC m=+485.848347463" watchObservedRunningTime="2026-07-07 14:38:43.667030867 +0000 UTC m=+485.849777738" Jul 07 14:38:51.633909 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:51.633881 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:52.641336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:52.641299 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-gdjtf" Jul 07 14:38:53.657550 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.657513 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz"] Jul 07 14:38:53.658072 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.657730 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" podUID="8175a60d-b026-4712-bf72-40d26821da7f" containerName="manager" containerID="cri-o://3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c" gracePeriod=2 Jul 07 14:38:53.667045 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.666971 2564 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8175a60d-b026-4712-bf72-40d26821da7f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\": pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:53.668731 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.668702 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz"] Jul 07 14:38:53.680173 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.680141 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9"] Jul 07 14:38:53.680649 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.680624 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8175a60d-b026-4712-bf72-40d26821da7f" containerName="manager" Jul 07 14:38:53.680649 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.680651 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="8175a60d-b026-4712-bf72-40d26821da7f" containerName="manager" Jul 07 14:38:53.680824 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.680750 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="8175a60d-b026-4712-bf72-40d26821da7f" containerName="manager" Jul 07 14:38:53.687830 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.687780 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4"] Jul 07 14:38:53.687993 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.687958 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:53.688101 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.688068 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" containerName="manager" containerID="cri-o://23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d" gracePeriod=2 Jul 07 14:38:53.690295 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.690140 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:53.691767 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.690675 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:53.692367 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.692154 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:53.694237 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.694201 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:53.694380 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.694364 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4"] Jul 07 14:38:53.697248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.697226 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9"] Jul 07 14:38:53.712924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.709853 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv"] Jul 07 14:38:53.712924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.710745 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" containerName="manager" Jul 07 14:38:53.712924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.710763 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" containerName="manager" Jul 07 14:38:53.712924 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.711013 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" containerName="manager" Jul 07 14:38:53.715257 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.715235 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:38:53.718631 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.718587 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:53.721132 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.721097 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:38:53.722820 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:38:53.722680 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:38:53.726717 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.726684 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv"] Jul 07 14:38:53.773021 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.772981 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gfpc9\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:53.773213 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.773045 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5bbx\" (UniqueName: \"kubernetes.io/projected/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-kube-api-access-t5bbx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gfpc9\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:53.773213 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.773132 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrclr\" (UniqueName: \"kubernetes.io/projected/9c3df971-760f-4a89-8db8-106e7017146f-kube-api-access-zrclr\") pod \"limitador-operator-controller-manager-859d7b78bd-qp5gv\" (UID: \"9c3df971-760f-4a89-8db8-106e7017146f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:38:53.874047 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.873998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrclr\" (UniqueName: \"kubernetes.io/projected/9c3df971-760f-4a89-8db8-106e7017146f-kube-api-access-zrclr\") pod \"limitador-operator-controller-manager-859d7b78bd-qp5gv\" (UID: \"9c3df971-760f-4a89-8db8-106e7017146f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:38:53.874236 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.874131 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gfpc9\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:53.874305 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.874240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5bbx\" (UniqueName: \"kubernetes.io/projected/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-kube-api-access-t5bbx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gfpc9\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:53.874611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.874578 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gfpc9\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:53.886931 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.886896 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrclr\" (UniqueName: \"kubernetes.io/projected/9c3df971-760f-4a89-8db8-106e7017146f-kube-api-access-zrclr\") pod \"limitador-operator-controller-manager-859d7b78bd-qp5gv\" (UID: \"9c3df971-760f-4a89-8db8-106e7017146f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:38:53.886931 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:53.886953 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5bbx\" (UniqueName: \"kubernetes.io/projected/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-kube-api-access-t5bbx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gfpc9\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:54.100358 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:54.100318 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:38:54.106785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:38:54.106757 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:39:03.711892 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:03.711820 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7fdd98b4d6-bf8sp" podUID="717cc4cb-0796-468d-9833-440e139fb958" containerName="console" containerID="cri-o://76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471" gracePeriod=15 Jul 07 14:39:05.519858 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:05.519815 2564 patch_prober.go:28] interesting pod/console-7fdd98b4d6-bf8sp container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" start-of-body= Jul 07 14:39:05.520306 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:05.519889 2564 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-7fdd98b4d6-bf8sp" podUID="717cc4cb-0796-468d-9833-440e139fb958" containerName="console" probeResult="failure" output="Get \"https://10.133.0.16:8443/health\": dial tcp 10.133.0.16:8443: connect: connection refused" Jul 07 14:39:06.645116 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.645036 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.648967 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.648912 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.667139 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.667113 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9"] Jul 07 14:39:06.668420 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.668383 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:06.670755 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.670708 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:06.671631 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.671552 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:39:06.673120 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.673048 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.673914 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:39:06.673872 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13dabcce_3e4c_41d9_9eeb_a4b909af3f51.slice/crio-dafc4ec4fb5048acb2c33d46335aefce5d139d4ecc45ccb6c44f05d0eb80b68b WatchSource:0}: Error finding container dafc4ec4fb5048acb2c33d46335aefce5d139d4ecc45ccb6c44f05d0eb80b68b: Status 404 returned error can't find the container with id dafc4ec4fb5048acb2c33d46335aefce5d139d4ecc45ccb6c44f05d0eb80b68b Jul 07 14:39:06.675294 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.675169 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.696958 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.696888 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv"] Jul 07 14:39:06.698980 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:39:06.698921 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3df971_760f_4a89_8db8_106e7017146f.slice/crio-a76d39e89ab4e811713abc844e45b7b023f49054cdb389b85741f3bf35f3b6a6 WatchSource:0}: Error finding container a76d39e89ab4e811713abc844e45b7b023f49054cdb389b85741f3bf35f3b6a6: Status 404 returned error can't find the container with id a76d39e89ab4e811713abc844e45b7b023f49054cdb389b85741f3bf35f3b6a6 Jul 07 14:39:06.699216 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.699156 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:06.804872 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.804833 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" event={"ID":"13dabcce-3e4c-41d9-9eeb-a4b909af3f51","Type":"ContainerStarted","Data":"0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c"} Jul 07 14:39:06.805093 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.804930 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" event={"ID":"13dabcce-3e4c-41d9-9eeb-a4b909af3f51","Type":"ContainerStarted","Data":"dafc4ec4fb5048acb2c33d46335aefce5d139d4ecc45ccb6c44f05d0eb80b68b"} Jul 07 14:39:06.805093 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.804989 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:39:06.805440 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805286 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bv25\" (UniqueName: \"kubernetes.io/projected/717cc4cb-0796-468d-9833-440e139fb958-kube-api-access-7bv25\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.805440 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805362 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7tq6\" (UniqueName: \"kubernetes.io/projected/8175a60d-b026-4712-bf72-40d26821da7f-kube-api-access-v7tq6\") pod \"8175a60d-b026-4712-bf72-40d26821da7f\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " Jul 07 14:39:06.805756 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805716 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-oauth-config\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.805867 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805817 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-console-config\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.805985 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805877 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr5jd\" (UniqueName: \"kubernetes.io/projected/b3ca751a-5a01-4589-82f0-d926236a29b7-kube-api-access-kr5jd\") pod \"b3ca751a-5a01-4589-82f0-d926236a29b7\" (UID: \"b3ca751a-5a01-4589-82f0-d926236a29b7\") " Jul 07 14:39:06.805985 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805916 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-oauth-serving-cert\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.805985 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.805971 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-service-ca\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.806217 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.806006 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8175a60d-b026-4712-bf72-40d26821da7f-extensions-socket-volume\") pod \"8175a60d-b026-4712-bf72-40d26821da7f\" (UID: \"8175a60d-b026-4712-bf72-40d26821da7f\") " Jul 07 14:39:06.806217 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.806035 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-trusted-ca-bundle\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.806421 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.806398 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:06.806620 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.806536 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-serving-cert\") pod \"717cc4cb-0796-468d-9833-440e139fb958\" (UID: \"717cc4cb-0796-468d-9833-440e139fb958\") " Jul 07 14:39:06.806777 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.806721 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-console-config" (OuterVolumeSpecName: "console-config") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:06.807240 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.807136 2564 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-console-config\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.807240 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.807181 2564 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-oauth-serving-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.807859 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.807826 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8175a60d-b026-4712-bf72-40d26821da7f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8175a60d-b026-4712-bf72-40d26821da7f" (UID: "8175a60d-b026-4712-bf72-40d26821da7f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:39:06.808331 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.808270 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/717cc4cb-0796-468d-9833-440e139fb958-kube-api-access-7bv25" (OuterVolumeSpecName: "kube-api-access-7bv25") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "kube-api-access-7bv25". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:06.808432 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.808386 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8175a60d-b026-4712-bf72-40d26821da7f-kube-api-access-v7tq6" (OuterVolumeSpecName: "kube-api-access-v7tq6") pod "8175a60d-b026-4712-bf72-40d26821da7f" (UID: "8175a60d-b026-4712-bf72-40d26821da7f"). InnerVolumeSpecName "kube-api-access-v7tq6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:06.808611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.808583 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:06.808611 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.808594 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-service-ca" (OuterVolumeSpecName: "service-ca") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:06.808748 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.808608 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:39:06.808853 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.808812 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:06.809502 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.809348 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" event={"ID":"9c3df971-760f-4a89-8db8-106e7017146f","Type":"ContainerStarted","Data":"b38886848adba44cc3dcb7d79f36fc33473f89fc2a19c85394bc46368a5edbf1"} Jul 07 14:39:06.809502 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.809402 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" event={"ID":"9c3df971-760f-4a89-8db8-106e7017146f","Type":"ContainerStarted","Data":"a76d39e89ab4e811713abc844e45b7b023f49054cdb389b85741f3bf35f3b6a6"} Jul 07 14:39:06.809502 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.809460 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:39:06.810005 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.809978 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "717cc4cb-0796-468d-9833-440e139fb958" (UID: "717cc4cb-0796-468d-9833-440e139fb958"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:39:06.810208 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.810180 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ca751a-5a01-4589-82f0-d926236a29b7-kube-api-access-kr5jd" (OuterVolumeSpecName: "kube-api-access-kr5jd") pod "b3ca751a-5a01-4589-82f0-d926236a29b7" (UID: "b3ca751a-5a01-4589-82f0-d926236a29b7"). InnerVolumeSpecName "kube-api-access-kr5jd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:06.811059 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.811026 2564 generic.go:356] "Generic (PLEG): container finished" podID="717cc4cb-0796-468d-9833-440e139fb958" containerID="76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471" exitCode=0 Jul 07 14:39:06.811140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.811103 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7fdd98b4d6-bf8sp" Jul 07 14:39:06.811140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.811108 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdd98b4d6-bf8sp" event={"ID":"717cc4cb-0796-468d-9833-440e139fb958","Type":"ContainerDied","Data":"76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471"} Jul 07 14:39:06.811232 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.811156 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7fdd98b4d6-bf8sp" event={"ID":"717cc4cb-0796-468d-9833-440e139fb958","Type":"ContainerDied","Data":"7649005a3ec65771b690c51edf9e3e69e32026e64ffaec2b74cd4740254c67e5"} Jul 07 14:39:06.811232 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.811187 2564 scope.go:117] "RemoveContainer" containerID="76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471" Jul 07 14:39:06.813295 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.813197 2564 generic.go:356] "Generic (PLEG): container finished" podID="8175a60d-b026-4712-bf72-40d26821da7f" containerID="3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c" exitCode=0 Jul 07 14:39:06.813295 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.813268 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:06.817410 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.817375 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" event={"ID":"a89b5f2b-7dcb-4b29-aecc-abedc7d34539","Type":"ContainerStarted","Data":"94d5508bf88f5b7c825b43e72c0eb41541799fe35e448b34ac8a78ecd0b5e435"} Jul 07 14:39:06.819581 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.819552 2564 generic.go:356] "Generic (PLEG): container finished" podID="b3ca751a-5a01-4589-82f0-d926236a29b7" containerID="23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d" exitCode=0 Jul 07 14:39:06.819710 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.819609 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.821580 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.821560 2564 scope.go:117] "RemoveContainer" containerID="76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471" Jul 07 14:39:06.821864 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.821840 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471\": container with ID starting with 76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471 not found: ID does not exist" containerID="76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471" Jul 07 14:39:06.821958 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.821877 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471"} err="failed to get container status \"76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471\": rpc error: code = NotFound desc = could not find container \"76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471\": container with ID starting with 76e2d861938e01a3cf8a8ad542625820304c57c4cffac61dc00501bee2b3a471 not found: ID does not exist" Jul 07 14:39:06.821958 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.821903 2564 scope.go:117] "RemoveContainer" containerID="3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c" Jul 07 14:39:06.830674 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.830635 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.831728 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.831689 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" podStartSLOduration=13.831673515 podStartE2EDuration="13.831673515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:06.828907278 +0000 UTC m=+509.011654146" watchObservedRunningTime="2026-07-07 14:39:06.831673515 +0000 UTC m=+509.014420384" Jul 07 14:39:06.832294 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.832210 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:06.832391 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.832374 2564 scope.go:117] "RemoveContainer" containerID="3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c" Jul 07 14:39:06.832704 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.832682 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c\": container with ID starting with 3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c not found: ID does not exist" containerID="3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c" Jul 07 14:39:06.832775 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.832708 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c"} err="failed to get container status \"3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c\": rpc error: code = NotFound desc = could not find container \"3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c\": container with ID starting with 3178a699e35eaaa20da242fe02b5305fd7e924025bba9e12d9ab00a4799dff5c not found: ID does not exist" Jul 07 14:39:06.832775 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.832728 2564 scope.go:117] "RemoveContainer" containerID="23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d" Jul 07 14:39:06.841510 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.841488 2564 scope.go:117] "RemoveContainer" containerID="23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d" Jul 07 14:39:06.841846 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.841825 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d\": container with ID starting with 23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d not found: ID does not exist" containerID="23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d" Jul 07 14:39:06.841897 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.841862 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d"} err="failed to get container status \"23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d\": rpc error: code = NotFound desc = could not find container \"23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d\": container with ID starting with 23c6de2f15563f73a6b7cfba0049f917d0d7e4ccf0f9c385a2a2215d1068838d not found: ID does not exist" Jul 07 14:39:06.848503 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.848453 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" podStartSLOduration=13.848436368 podStartE2EDuration="13.848436368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:06.84781961 +0000 UTC m=+509.030566481" watchObservedRunningTime="2026-07-07 14:39:06.848436368 +0000 UTC m=+509.031183216" Jul 07 14:39:06.861398 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.861365 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7fdd98b4d6-bf8sp"] Jul 07 14:39:06.863842 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:06.863802 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:06.865193 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.865174 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7fdd98b4d6-bf8sp"] Jul 07 14:39:06.878340 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.878291 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-6h4sc" podStartSLOduration=1.3014288729999999 podStartE2EDuration="24.878272701s" totalImagesPullingTime="23.576843828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:38:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:06.877192135 +0000 UTC m=+509.059939008" watchObservedRunningTime="2026-07-07 14:39:06.878272701 +0000 UTC m=+509.061019600" Jul 07 14:39:06.908048 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908000 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bv25\" (UniqueName: \"kubernetes.io/projected/717cc4cb-0796-468d-9833-440e139fb958-kube-api-access-7bv25\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908048 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908030 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7tq6\" (UniqueName: \"kubernetes.io/projected/8175a60d-b026-4712-bf72-40d26821da7f-kube-api-access-v7tq6\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908048 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908044 2564 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-oauth-config\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908048 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908056 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr5jd\" (UniqueName: \"kubernetes.io/projected/b3ca751a-5a01-4589-82f0-d926236a29b7-kube-api-access-kr5jd\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908069 2564 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-service-ca\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908081 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8175a60d-b026-4712-bf72-40d26821da7f-extensions-socket-volume\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908092 2564 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/717cc4cb-0796-468d-9833-440e139fb958-trusted-ca-bundle\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:06.908478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:06.908104 2564 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/717cc4cb-0796-468d-9833-440e139fb958-console-serving-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:08.500815 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:08.500778 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-prmh4\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-prmh4" Jul 07 14:39:08.502159 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:08.502137 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="717cc4cb-0796-468d-9833-440e139fb958" path="/var/lib/kubelet/pods/717cc4cb-0796-468d-9833-440e139fb958/volumes" Jul 07 14:39:08.502466 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:08.502443 2564 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-zr5rz\" is forbidden: User \"system:node:ip-10-0-136-116.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-116.ec2.internal' and this object" podUID="8175a60d-b026-4712-bf72-40d26821da7f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-zr5rz" Jul 07 14:39:08.502660 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:08.502640 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8175a60d-b026-4712-bf72-40d26821da7f" path="/var/lib/kubelet/pods/8175a60d-b026-4712-bf72-40d26821da7f/volumes" Jul 07 14:39:08.503064 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:08.503050 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3ca751a-5a01-4589-82f0-d926236a29b7" path="/var/lib/kubelet/pods/b3ca751a-5a01-4589-82f0-d926236a29b7/volumes" Jul 07 14:39:11.263530 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.263490 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9"] Jul 07 14:39:11.264078 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.263824 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" podUID="13dabcce-3e4c-41d9-9eeb-a4b909af3f51" containerName="manager" containerID="cri-o://0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c" gracePeriod=10 Jul 07 14:39:11.265907 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.265883 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:39:11.513660 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.513597 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:39:11.651383 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.651347 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5bbx\" (UniqueName: \"kubernetes.io/projected/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-kube-api-access-t5bbx\") pod \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " Jul 07 14:39:11.651552 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.651478 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-extensions-socket-volume\") pod \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\" (UID: \"13dabcce-3e4c-41d9-9eeb-a4b909af3f51\") " Jul 07 14:39:11.651923 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.651894 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "13dabcce-3e4c-41d9-9eeb-a4b909af3f51" (UID: "13dabcce-3e4c-41d9-9eeb-a4b909af3f51"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 07 14:39:11.653504 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.653483 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-kube-api-access-t5bbx" (OuterVolumeSpecName: "kube-api-access-t5bbx") pod "13dabcce-3e4c-41d9-9eeb-a4b909af3f51" (UID: "13dabcce-3e4c-41d9-9eeb-a4b909af3f51"). InnerVolumeSpecName "kube-api-access-t5bbx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:11.752616 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.752583 2564 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-extensions-socket-volume\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:11.752616 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.752612 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5bbx\" (UniqueName: \"kubernetes.io/projected/13dabcce-3e4c-41d9-9eeb-a4b909af3f51-kube-api-access-t5bbx\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:11.854673 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.854570 2564 generic.go:356] "Generic (PLEG): container finished" podID="13dabcce-3e4c-41d9-9eeb-a4b909af3f51" containerID="0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c" exitCode=0 Jul 07 14:39:11.854673 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.854622 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" Jul 07 14:39:11.854673 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.854665 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" event={"ID":"13dabcce-3e4c-41d9-9eeb-a4b909af3f51","Type":"ContainerDied","Data":"0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c"} Jul 07 14:39:11.854995 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.854716 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9" event={"ID":"13dabcce-3e4c-41d9-9eeb-a4b909af3f51","Type":"ContainerDied","Data":"dafc4ec4fb5048acb2c33d46335aefce5d139d4ecc45ccb6c44f05d0eb80b68b"} Jul 07 14:39:11.854995 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.854737 2564 scope.go:117] "RemoveContainer" containerID="0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c" Jul 07 14:39:11.864518 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.864495 2564 scope.go:117] "RemoveContainer" containerID="0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c" Jul 07 14:39:11.864825 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:11.864805 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c\": container with ID starting with 0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c not found: ID does not exist" containerID="0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c" Jul 07 14:39:11.864902 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.864835 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c"} err="failed to get container status \"0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c\": rpc error: code = NotFound desc = could not find container \"0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c\": container with ID starting with 0bac2d4122a1514cc54864af9946aee6ddb5369cf74aa8fbe525f2bd96715f7c not found: ID does not exist" Jul 07 14:39:11.875810 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.875783 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9"] Jul 07 14:39:11.881922 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:11.881898 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gfpc9"] Jul 07 14:39:12.502558 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:12.502526 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13dabcce-3e4c-41d9-9eeb-a4b909af3f51" path="/var/lib/kubelet/pods/13dabcce-3e4c-41d9-9eeb-a4b909af3f51/volumes" Jul 07 14:39:17.830881 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:17.830850 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qp5gv" Jul 07 14:39:27.637849 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.637812 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq"] Jul 07 14:39:27.638248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.638218 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="717cc4cb-0796-468d-9833-440e139fb958" containerName="console" Jul 07 14:39:27.638248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.638233 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="717cc4cb-0796-468d-9833-440e139fb958" containerName="console" Jul 07 14:39:27.638248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.638244 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13dabcce-3e4c-41d9-9eeb-a4b909af3f51" containerName="manager" Jul 07 14:39:27.638248 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.638249 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="13dabcce-3e4c-41d9-9eeb-a4b909af3f51" containerName="manager" Jul 07 14:39:27.638382 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.638324 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="717cc4cb-0796-468d-9833-440e139fb958" containerName="console" Jul 07 14:39:27.638382 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.638336 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="13dabcce-3e4c-41d9-9eeb-a4b909af3f51" containerName="manager" Jul 07 14:39:27.788730 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.788693 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq"] Jul 07 14:39:27.788893 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.788820 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.791410 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.791391 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-7zjkb\"" Jul 07 14:39:27.883524 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883480 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nzcd\" (UniqueName: \"kubernetes.io/projected/bc48c11d-5dfd-4e85-a033-3d362840c69a-kube-api-access-8nzcd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883524 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883526 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883548 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883667 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883700 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc48c11d-5dfd-4e85-a033-3d362840c69a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883732 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883760 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.883785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883782 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.884106 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.883805 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985044 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.984998 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985051 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc48c11d-5dfd-4e85-a033-3d362840c69a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985084 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985107 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985132 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985155 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985310 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985240 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nzcd\" (UniqueName: \"kubernetes.io/projected/bc48c11d-5dfd-4e85-a033-3d362840c69a-kube-api-access-8nzcd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985688 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985334 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985688 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985557 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985688 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985642 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985877 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.985898 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985888 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.986042 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985918 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.986042 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.985969 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bc48c11d-5dfd-4e85-a033-3d362840c69a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.987535 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.987507 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.988067 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.988050 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.994024 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.993992 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bc48c11d-5dfd-4e85-a033-3d362840c69a-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:27.994247 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:27.994224 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nzcd\" (UniqueName: \"kubernetes.io/projected/bc48c11d-5dfd-4e85-a033-3d362840c69a-kube-api-access-8nzcd\") pod \"maas-default-gateway-openshift-default-5896d4dd49-c5sbq\" (UID: \"bc48c11d-5dfd-4e85-a033-3d362840c69a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:28.100093 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.100045 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:28.282872 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.282847 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq"] Jul 07 14:39:28.284267 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:39:28.284241 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc48c11d_5dfd_4e85_a033_3d362840c69a.slice/crio-e0d78615dfb40d53e790e438ec18dcfc84c50f0ed01f6c3e4a2c9d8ea8d581f9 WatchSource:0}: Error finding container e0d78615dfb40d53e790e438ec18dcfc84c50f0ed01f6c3e4a2c9d8ea8d581f9: Status 404 returned error can't find the container with id e0d78615dfb40d53e790e438ec18dcfc84c50f0ed01f6c3e4a2c9d8ea8d581f9 Jul 07 14:39:28.294698 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.287376 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:39:28.294698 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.287559 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:39:28.294698 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.287658 2564 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"} Jul 07 14:39:28.946341 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.946296 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" event={"ID":"bc48c11d-5dfd-4e85-a033-3d362840c69a","Type":"ContainerStarted","Data":"c5b792e4e48dd755328a5753eb4d35ab2965799cba3057f6a0f130223e803b9c"} Jul 07 14:39:28.946746 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.946374 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" event={"ID":"bc48c11d-5dfd-4e85-a033-3d362840c69a","Type":"ContainerStarted","Data":"e0d78615dfb40d53e790e438ec18dcfc84c50f0ed01f6c3e4a2c9d8ea8d581f9"} Jul 07 14:39:28.967125 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:28.967058 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" podStartSLOduration=1.967035128 podStartE2EDuration="1.967035128s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:28.965896141 +0000 UTC m=+531.148643024" watchObservedRunningTime="2026-07-07 14:39:28.967035128 +0000 UTC m=+531.149781999" Jul 07 14:39:29.100626 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:29.100584 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:29.105601 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:29.105573 2564 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:29.952389 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:29.952310 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:29.953203 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:29.953186 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-c5sbq" Jul 07 14:39:30.024958 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.024906 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:30.059278 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.059244 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:30.059474 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.059372 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.061796 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.061766 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 07 14:39:30.105785 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.105745 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp7lr\" (UniqueName: \"kubernetes.io/projected/1dbbdd98-4067-4687-ab7b-fa9424810923-kube-api-access-tp7lr\") pod \"limitador-limitador-64c94fd64f-nc4z7\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.106019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.105865 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dbbdd98-4067-4687-ab7b-fa9424810923-config-file\") pod \"limitador-limitador-64c94fd64f-nc4z7\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.125803 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.125773 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:30.141513 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.141479 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tvfh"] Jul 07 14:39:30.148092 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.148062 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.155869 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.155837 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tvfh"] Jul 07 14:39:30.183395 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.183359 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tvfh"] Jul 07 14:39:30.207115 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.207023 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sr655\" (UniqueName: \"kubernetes.io/projected/ca68918f-2f24-4b4f-b5da-05af5ef46d29-kube-api-access-sr655\") pod \"limitador-limitador-54d6d988d5-4tvfh\" (UID: \"ca68918f-2f24-4b4f-b5da-05af5ef46d29\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.207265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.207123 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp7lr\" (UniqueName: \"kubernetes.io/projected/1dbbdd98-4067-4687-ab7b-fa9424810923-kube-api-access-tp7lr\") pod \"limitador-limitador-64c94fd64f-nc4z7\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.207265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.207180 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca68918f-2f24-4b4f-b5da-05af5ef46d29-config-file\") pod \"limitador-limitador-54d6d988d5-4tvfh\" (UID: \"ca68918f-2f24-4b4f-b5da-05af5ef46d29\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.207265 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.207209 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dbbdd98-4067-4687-ab7b-fa9424810923-config-file\") pod \"limitador-limitador-64c94fd64f-nc4z7\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.208092 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.208061 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dbbdd98-4067-4687-ab7b-fa9424810923-config-file\") pod \"limitador-limitador-64c94fd64f-nc4z7\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.215440 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.215362 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp7lr\" (UniqueName: \"kubernetes.io/projected/1dbbdd98-4067-4687-ab7b-fa9424810923-kube-api-access-tp7lr\") pod \"limitador-limitador-64c94fd64f-nc4z7\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.308453 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.308418 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca68918f-2f24-4b4f-b5da-05af5ef46d29-config-file\") pod \"limitador-limitador-54d6d988d5-4tvfh\" (UID: \"ca68918f-2f24-4b4f-b5da-05af5ef46d29\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.308638 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.308491 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sr655\" (UniqueName: \"kubernetes.io/projected/ca68918f-2f24-4b4f-b5da-05af5ef46d29-kube-api-access-sr655\") pod \"limitador-limitador-54d6d988d5-4tvfh\" (UID: \"ca68918f-2f24-4b4f-b5da-05af5ef46d29\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.309105 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.309086 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ca68918f-2f24-4b4f-b5da-05af5ef46d29-config-file\") pod \"limitador-limitador-54d6d988d5-4tvfh\" (UID: \"ca68918f-2f24-4b4f-b5da-05af5ef46d29\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.316680 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.316654 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sr655\" (UniqueName: \"kubernetes.io/projected/ca68918f-2f24-4b4f-b5da-05af5ef46d29-kube-api-access-sr655\") pod \"limitador-limitador-54d6d988d5-4tvfh\" (UID: \"ca68918f-2f24-4b4f-b5da-05af5ef46d29\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.370207 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.370166 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:30.461695 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.461612 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:30.578387 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:39:30.578350 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbbdd98_4067_4687_ab7b_fa9424810923.slice/crio-7fd138df77aebef648087c56b743530473492f53e61ca587e476c7714c23ebef WatchSource:0}: Error finding container 7fd138df77aebef648087c56b743530473492f53e61ca587e476c7714c23ebef: Status 404 returned error can't find the container with id 7fd138df77aebef648087c56b743530473492f53e61ca587e476c7714c23ebef Jul 07 14:39:30.578533 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.578384 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:30.621789 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.621767 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-4tvfh"] Jul 07 14:39:30.623836 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:39:30.623810 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca68918f_2f24_4b4f_b5da_05af5ef46d29.slice/crio-3d327288143db8d9bb710dece909a4292ee06bb107bd2778df432cd70892f3cc WatchSource:0}: Error finding container 3d327288143db8d9bb710dece909a4292ee06bb107bd2778df432cd70892f3cc: Status 404 returned error can't find the container with id 3d327288143db8d9bb710dece909a4292ee06bb107bd2778df432cd70892f3cc Jul 07 14:39:30.958819 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.958791 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-6hgrq"] Jul 07 14:39:30.978223 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.978181 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6hgrq"] Jul 07 14:39:30.978223 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.978218 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" event={"ID":"1dbbdd98-4067-4687-ab7b-fa9424810923","Type":"ContainerStarted","Data":"7fd138df77aebef648087c56b743530473492f53e61ca587e476c7714c23ebef"} Jul 07 14:39:30.978478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.978262 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" event={"ID":"ca68918f-2f24-4b4f-b5da-05af5ef46d29","Type":"ContainerStarted","Data":"3d327288143db8d9bb710dece909a4292ee06bb107bd2778df432cd70892f3cc"} Jul 07 14:39:30.978478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.978315 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:39:30.981045 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:30.981019 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-b5pmv\"" Jul 07 14:39:31.015862 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:31.015826 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xfft\" (UniqueName: \"kubernetes.io/projected/cf68ea68-72ac-4a45-b3f2-ef003d8d603e-kube-api-access-5xfft\") pod \"authorino-75d556bd77-6hgrq\" (UID: \"cf68ea68-72ac-4a45-b3f2-ef003d8d603e\") " pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:39:31.117218 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:31.117185 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xfft\" (UniqueName: \"kubernetes.io/projected/cf68ea68-72ac-4a45-b3f2-ef003d8d603e-kube-api-access-5xfft\") pod \"authorino-75d556bd77-6hgrq\" (UID: \"cf68ea68-72ac-4a45-b3f2-ef003d8d603e\") " pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:39:31.125158 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:31.125135 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xfft\" (UniqueName: \"kubernetes.io/projected/cf68ea68-72ac-4a45-b3f2-ef003d8d603e-kube-api-access-5xfft\") pod \"authorino-75d556bd77-6hgrq\" (UID: \"cf68ea68-72ac-4a45-b3f2-ef003d8d603e\") " pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:39:31.289669 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:31.289626 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:39:31.533386 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:31.533291 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6hgrq"] Jul 07 14:39:31.537156 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:39:31.537118 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf68ea68_72ac_4a45_b3f2_ef003d8d603e.slice/crio-3745eff238fd2f284313bdcaeeb796dc49c4cacf2df0ba01d56a77be0e1d8623 WatchSource:0}: Error finding container 3745eff238fd2f284313bdcaeeb796dc49c4cacf2df0ba01d56a77be0e1d8623: Status 404 returned error can't find the container with id 3745eff238fd2f284313bdcaeeb796dc49c4cacf2df0ba01d56a77be0e1d8623 Jul 07 14:39:31.970215 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:31.970144 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6hgrq" event={"ID":"cf68ea68-72ac-4a45-b3f2-ef003d8d603e","Type":"ContainerStarted","Data":"3745eff238fd2f284313bdcaeeb796dc49c4cacf2df0ba01d56a77be0e1d8623"} Jul 07 14:39:35.998024 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:35.997976 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" event={"ID":"ca68918f-2f24-4b4f-b5da-05af5ef46d29","Type":"ContainerStarted","Data":"1911a1b8e94acd1e4731ada1487f64f2f85dd3804c341ce35a3204713f417d24"} Jul 07 14:39:35.998474 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:35.998061 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:35.999576 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:35.999553 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6hgrq" event={"ID":"cf68ea68-72ac-4a45-b3f2-ef003d8d603e","Type":"ContainerStarted","Data":"d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00"} Jul 07 14:39:36.001045 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:36.001025 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" event={"ID":"1dbbdd98-4067-4687-ab7b-fa9424810923","Type":"ContainerStarted","Data":"cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4"} Jul 07 14:39:36.001184 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:36.001163 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:36.018324 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:36.018280 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" podStartSLOduration=0.90145557 podStartE2EDuration="6.018266793s" totalImagesPullingTime="5.116811223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:36.015895566 +0000 UTC m=+538.198642448" watchObservedRunningTime="2026-07-07 14:39:36.018266793 +0000 UTC m=+538.201013663" Jul 07 14:39:36.033645 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:36.033592 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" podStartSLOduration=0.970971732 podStartE2EDuration="6.033580729s" totalImagesPullingTime="5.062608997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:36.033041052 +0000 UTC m=+538.215787923" watchObservedRunningTime="2026-07-07 14:39:36.033580729 +0000 UTC m=+538.216327599" Jul 07 14:39:36.048788 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:36.048731 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-6hgrq" podStartSLOduration=2.029826491 podStartE2EDuration="6.048715259s" totalImagesPullingTime="4.018888768s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:39:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:39:36.047500082 +0000 UTC m=+538.230246943" watchObservedRunningTime="2026-07-07 14:39:36.048715259 +0000 UTC m=+538.231462128" Jul 07 14:39:47.008461 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.008429 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:47.008959 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.008533 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-4tvfh" Jul 07 14:39:47.084124 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.084090 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:47.084349 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.084313 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" podUID="1dbbdd98-4067-4687-ab7b-fa9424810923" containerName="limitador" containerID="cri-o://cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4" gracePeriod=30 Jul 07 14:39:47.662249 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.662179 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:47.775578 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.775541 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp7lr\" (UniqueName: \"kubernetes.io/projected/1dbbdd98-4067-4687-ab7b-fa9424810923-kube-api-access-tp7lr\") pod \"1dbbdd98-4067-4687-ab7b-fa9424810923\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " Jul 07 14:39:47.775784 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.775617 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dbbdd98-4067-4687-ab7b-fa9424810923-config-file\") pod \"1dbbdd98-4067-4687-ab7b-fa9424810923\" (UID: \"1dbbdd98-4067-4687-ab7b-fa9424810923\") " Jul 07 14:39:47.775960 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.775908 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1dbbdd98-4067-4687-ab7b-fa9424810923-config-file" (OuterVolumeSpecName: "config-file") pod "1dbbdd98-4067-4687-ab7b-fa9424810923" (UID: "1dbbdd98-4067-4687-ab7b-fa9424810923"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 07 14:39:47.777672 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.777652 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbbdd98-4067-4687-ab7b-fa9424810923-kube-api-access-tp7lr" (OuterVolumeSpecName: "kube-api-access-tp7lr") pod "1dbbdd98-4067-4687-ab7b-fa9424810923" (UID: "1dbbdd98-4067-4687-ab7b-fa9424810923"). InnerVolumeSpecName "kube-api-access-tp7lr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:39:47.877140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.877096 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp7lr\" (UniqueName: \"kubernetes.io/projected/1dbbdd98-4067-4687-ab7b-fa9424810923-kube-api-access-tp7lr\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:47.877140 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:47.877131 2564 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1dbbdd98-4067-4687-ab7b-fa9424810923-config-file\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:39:48.065712 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.065674 2564 generic.go:356] "Generic (PLEG): container finished" podID="1dbbdd98-4067-4687-ab7b-fa9424810923" containerID="cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4" exitCode=0 Jul 07 14:39:48.066179 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.065720 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" Jul 07 14:39:48.066179 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.065760 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" event={"ID":"1dbbdd98-4067-4687-ab7b-fa9424810923","Type":"ContainerDied","Data":"cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4"} Jul 07 14:39:48.066179 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.065827 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-nc4z7" event={"ID":"1dbbdd98-4067-4687-ab7b-fa9424810923","Type":"ContainerDied","Data":"7fd138df77aebef648087c56b743530473492f53e61ca587e476c7714c23ebef"} Jul 07 14:39:48.066179 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.065861 2564 scope.go:117] "RemoveContainer" containerID="cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4" Jul 07 14:39:48.075118 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.075101 2564 scope.go:117] "RemoveContainer" containerID="cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4" Jul 07 14:39:48.075383 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:39:48.075365 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4\": container with ID starting with cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4 not found: ID does not exist" containerID="cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4" Jul 07 14:39:48.075435 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.075393 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4"} err="failed to get container status \"cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4\": rpc error: code = NotFound desc = could not find container \"cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4\": container with ID starting with cbdb1cda5194dc732292e341c5121252574188beb6c9d6cecab2313df6be1ea4 not found: ID does not exist" Jul 07 14:39:48.104736 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.104702 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:48.106803 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.106781 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-nc4z7"] Jul 07 14:39:48.501957 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:39:48.501912 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1dbbdd98-4067-4687-ab7b-fa9424810923" path="/var/lib/kubelet/pods/1dbbdd98-4067-4687-ab7b-fa9424810923/volumes" Jul 07 14:40:04.055049 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.055006 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mb2tt"] Jul 07 14:40:04.055653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.055554 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbbdd98-4067-4687-ab7b-fa9424810923" containerName="limitador" Jul 07 14:40:04.055653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.055575 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbbdd98-4067-4687-ab7b-fa9424810923" containerName="limitador" Jul 07 14:40:04.055779 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.055685 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="1dbbdd98-4067-4687-ab7b-fa9424810923" containerName="limitador" Jul 07 14:40:04.075654 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.075623 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mb2tt"] Jul 07 14:40:04.075833 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.075763 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:04.231705 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.231666 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmvsm\" (UniqueName: \"kubernetes.io/projected/5b1e74c6-50f4-4dbf-a227-08c414af4939-kube-api-access-hmvsm\") pod \"authorino-5d4b67c446-mb2tt\" (UID: \"5b1e74c6-50f4-4dbf-a227-08c414af4939\") " pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:04.318210 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.318125 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mb2tt"] Jul 07 14:40:04.318448 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:40:04.318426 2564 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-hmvsm], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-mb2tt" podUID="5b1e74c6-50f4-4dbf-a227-08c414af4939" Jul 07 14:40:04.333001 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.332964 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmvsm\" (UniqueName: \"kubernetes.io/projected/5b1e74c6-50f4-4dbf-a227-08c414af4939-kube-api-access-hmvsm\") pod \"authorino-5d4b67c446-mb2tt\" (UID: \"5b1e74c6-50f4-4dbf-a227-08c414af4939\") " pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:04.345413 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:04.345378 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmvsm\" (UniqueName: \"kubernetes.io/projected/5b1e74c6-50f4-4dbf-a227-08c414af4939-kube-api-access-hmvsm\") pod \"authorino-5d4b67c446-mb2tt\" (UID: \"5b1e74c6-50f4-4dbf-a227-08c414af4939\") " pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:05.154421 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:05.154389 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:05.197600 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:05.197565 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:05.341287 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:05.341246 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hmvsm\" (UniqueName: \"kubernetes.io/projected/5b1e74c6-50f4-4dbf-a227-08c414af4939-kube-api-access-hmvsm\") pod \"5b1e74c6-50f4-4dbf-a227-08c414af4939\" (UID: \"5b1e74c6-50f4-4dbf-a227-08c414af4939\") " Jul 07 14:40:05.343396 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:05.343367 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b1e74c6-50f4-4dbf-a227-08c414af4939-kube-api-access-hmvsm" (OuterVolumeSpecName: "kube-api-access-hmvsm") pod "5b1e74c6-50f4-4dbf-a227-08c414af4939" (UID: "5b1e74c6-50f4-4dbf-a227-08c414af4939"). InnerVolumeSpecName "kube-api-access-hmvsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:05.442386 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:05.442290 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hmvsm\" (UniqueName: \"kubernetes.io/projected/5b1e74c6-50f4-4dbf-a227-08c414af4939-kube-api-access-hmvsm\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:40:06.159363 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.159331 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-mb2tt" Jul 07 14:40:06.188545 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.188506 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mb2tt"] Jul 07 14:40:06.190800 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.190776 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-mb2tt"] Jul 07 14:40:06.509021 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.508986 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b1e74c6-50f4-4dbf-a227-08c414af4939" path="/var/lib/kubelet/pods/5b1e74c6-50f4-4dbf-a227-08c414af4939/volumes" Jul 07 14:40:06.548673 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.548633 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6hgrq"] Jul 07 14:40:06.548868 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.548842 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-6hgrq" podUID="cf68ea68-72ac-4a45-b3f2-ef003d8d603e" containerName="authorino" containerID="cri-o://d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00" gracePeriod=30 Jul 07 14:40:06.809619 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.809595 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:40:06.954690 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.954648 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xfft\" (UniqueName: \"kubernetes.io/projected/cf68ea68-72ac-4a45-b3f2-ef003d8d603e-kube-api-access-5xfft\") pod \"cf68ea68-72ac-4a45-b3f2-ef003d8d603e\" (UID: \"cf68ea68-72ac-4a45-b3f2-ef003d8d603e\") " Jul 07 14:40:06.956807 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:06.956777 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf68ea68-72ac-4a45-b3f2-ef003d8d603e-kube-api-access-5xfft" (OuterVolumeSpecName: "kube-api-access-5xfft") pod "cf68ea68-72ac-4a45-b3f2-ef003d8d603e" (UID: "cf68ea68-72ac-4a45-b3f2-ef003d8d603e"). InnerVolumeSpecName "kube-api-access-5xfft". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:07.055491 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.055399 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xfft\" (UniqueName: \"kubernetes.io/projected/cf68ea68-72ac-4a45-b3f2-ef003d8d603e-kube-api-access-5xfft\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:40:07.166287 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.166246 2564 generic.go:356] "Generic (PLEG): container finished" podID="cf68ea68-72ac-4a45-b3f2-ef003d8d603e" containerID="d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00" exitCode=0 Jul 07 14:40:07.166287 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.166292 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-6hgrq" Jul 07 14:40:07.166805 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.166340 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6hgrq" event={"ID":"cf68ea68-72ac-4a45-b3f2-ef003d8d603e","Type":"ContainerDied","Data":"d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00"} Jul 07 14:40:07.166805 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.166382 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-6hgrq" event={"ID":"cf68ea68-72ac-4a45-b3f2-ef003d8d603e","Type":"ContainerDied","Data":"3745eff238fd2f284313bdcaeeb796dc49c4cacf2df0ba01d56a77be0e1d8623"} Jul 07 14:40:07.166805 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.166405 2564 scope.go:117] "RemoveContainer" containerID="d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00" Jul 07 14:40:07.175980 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.175864 2564 scope.go:117] "RemoveContainer" containerID="d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00" Jul 07 14:40:07.176278 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:40:07.176259 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00\": container with ID starting with d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00 not found: ID does not exist" containerID="d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00" Jul 07 14:40:07.176343 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.176287 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00"} err="failed to get container status \"d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00\": rpc error: code = NotFound desc = could not find container \"d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00\": container with ID starting with d6fa545b070d4a13aa39dd76f7412854ad83b31d40d638707c3beffc4dae7f00 not found: ID does not exist" Jul 07 14:40:07.187211 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.187178 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6hgrq"] Jul 07 14:40:07.189287 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:07.189263 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-6hgrq"] Jul 07 14:40:08.502139 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:08.502107 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf68ea68-72ac-4a45-b3f2-ef003d8d603e" path="/var/lib/kubelet/pods/cf68ea68-72ac-4a45-b3f2-ef003d8d603e/volumes" Jul 07 14:40:10.973398 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.973365 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-cbbf68f4b-j4w8r"] Jul 07 14:40:10.973781 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.973723 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf68ea68-72ac-4a45-b3f2-ef003d8d603e" containerName="authorino" Jul 07 14:40:10.973781 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.973733 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf68ea68-72ac-4a45-b3f2-ef003d8d603e" containerName="authorino" Jul 07 14:40:10.973862 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.973790 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf68ea68-72ac-4a45-b3f2-ef003d8d603e" containerName="authorino" Jul 07 14:40:10.977145 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.977121 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:10.980775 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.980754 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fs6js\"" Jul 07 14:40:10.981417 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.981400 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 07 14:40:10.981748 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.981733 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 07 14:40:10.989178 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:10.989155 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cbbf68f4b-j4w8r"] Jul 07 14:40:11.091709 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.091673 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ckcg\" (UniqueName: \"kubernetes.io/projected/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-kube-api-access-8ckcg\") pod \"maas-controller-cbbf68f4b-j4w8r\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.091914 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.091754 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-webhook-cert\") pod \"maas-controller-cbbf68f4b-j4w8r\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.157199 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.157166 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7cfd6cbc88-m48qs"] Jul 07 14:40:11.159614 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.159598 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.172228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.172191 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cfd6cbc88-m48qs"] Jul 07 14:40:11.192392 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.192355 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-webhook-cert\") pod \"maas-controller-cbbf68f4b-j4w8r\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.192579 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.192436 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ckcg\" (UniqueName: \"kubernetes.io/projected/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-kube-api-access-8ckcg\") pod \"maas-controller-cbbf68f4b-j4w8r\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.194891 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.194868 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-webhook-cert\") pod \"maas-controller-cbbf68f4b-j4w8r\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.201608 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.201564 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ckcg\" (UniqueName: \"kubernetes.io/projected/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-kube-api-access-8ckcg\") pod \"maas-controller-cbbf68f4b-j4w8r\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.287443 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.287345 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:11.293877 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.293844 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2sg\" (UniqueName: \"kubernetes.io/projected/1ec2d3e5-3836-434a-b54d-3a106104c40a-kube-api-access-jg2sg\") pod \"maas-controller-7cfd6cbc88-m48qs\" (UID: \"1ec2d3e5-3836-434a-b54d-3a106104c40a\") " pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.294019 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.293974 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ec2d3e5-3836-434a-b54d-3a106104c40a-webhook-cert\") pod \"maas-controller-7cfd6cbc88-m48qs\" (UID: \"1ec2d3e5-3836-434a-b54d-3a106104c40a\") " pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.394608 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.394554 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ec2d3e5-3836-434a-b54d-3a106104c40a-webhook-cert\") pod \"maas-controller-7cfd6cbc88-m48qs\" (UID: \"1ec2d3e5-3836-434a-b54d-3a106104c40a\") " pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.394795 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.394696 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2sg\" (UniqueName: \"kubernetes.io/projected/1ec2d3e5-3836-434a-b54d-3a106104c40a-kube-api-access-jg2sg\") pod \"maas-controller-7cfd6cbc88-m48qs\" (UID: \"1ec2d3e5-3836-434a-b54d-3a106104c40a\") " pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.397436 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.397399 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1ec2d3e5-3836-434a-b54d-3a106104c40a-webhook-cert\") pod \"maas-controller-7cfd6cbc88-m48qs\" (UID: \"1ec2d3e5-3836-434a-b54d-3a106104c40a\") " pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.403349 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.403316 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2sg\" (UniqueName: \"kubernetes.io/projected/1ec2d3e5-3836-434a-b54d-3a106104c40a-kube-api-access-jg2sg\") pod \"maas-controller-7cfd6cbc88-m48qs\" (UID: \"1ec2d3e5-3836-434a-b54d-3a106104c40a\") " pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.429347 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.429321 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-cbbf68f4b-j4w8r"] Jul 07 14:40:11.431289 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:40:11.431260 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6d3b17_7bc2_4bb7_9411_50a66e271cca.slice/crio-5ac4693d37dd3143c5b55bd8398ace9133a6183bf8447e1913f7f3005bdc0ce1 WatchSource:0}: Error finding container 5ac4693d37dd3143c5b55bd8398ace9133a6183bf8447e1913f7f3005bdc0ce1: Status 404 returned error can't find the container with id 5ac4693d37dd3143c5b55bd8398ace9133a6183bf8447e1913f7f3005bdc0ce1 Jul 07 14:40:11.470512 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.470473 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:11.609636 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:11.609608 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7cfd6cbc88-m48qs"] Jul 07 14:40:11.611358 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:40:11.611333 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec2d3e5_3836_434a_b54d_3a106104c40a.slice/crio-30636e4ddaeaf81192fbbba48bdc6efb47bc03bf89574be0d922ef5f9d6586ef WatchSource:0}: Error finding container 30636e4ddaeaf81192fbbba48bdc6efb47bc03bf89574be0d922ef5f9d6586ef: Status 404 returned error can't find the container with id 30636e4ddaeaf81192fbbba48bdc6efb47bc03bf89574be0d922ef5f9d6586ef Jul 07 14:40:12.195433 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:12.195394 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" event={"ID":"1ec2d3e5-3836-434a-b54d-3a106104c40a","Type":"ContainerStarted","Data":"30636e4ddaeaf81192fbbba48bdc6efb47bc03bf89574be0d922ef5f9d6586ef"} Jul 07 14:40:12.196783 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:12.196759 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" event={"ID":"6d6d3b17-7bc2-4bb7-9411-50a66e271cca","Type":"ContainerStarted","Data":"5ac4693d37dd3143c5b55bd8398ace9133a6183bf8447e1913f7f3005bdc0ce1"} Jul 07 14:40:14.211723 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:14.211609 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" event={"ID":"6d6d3b17-7bc2-4bb7-9411-50a66e271cca","Type":"ContainerStarted","Data":"7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca"} Jul 07 14:40:14.212197 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:14.211803 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:14.213340 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:14.213314 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" event={"ID":"1ec2d3e5-3836-434a-b54d-3a106104c40a","Type":"ContainerStarted","Data":"f15d73622ab9ba1f4c8bba85d224309201d33c31c293593223bae57ff4b06375"} Jul 07 14:40:14.213458 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:14.213435 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:14.229666 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:14.229599 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" podStartSLOduration=1.914986729 podStartE2EDuration="4.229576423s" totalImagesPullingTime="2.314589694s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:14.228308258 +0000 UTC m=+576.411055130" watchObservedRunningTime="2026-07-07 14:40:14.229576423 +0000 UTC m=+576.412323294" Jul 07 14:40:14.247325 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:14.247269 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" podStartSLOduration=1.11952691 podStartE2EDuration="3.247250367s" totalImagesPullingTime="2.127723457s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:40:14.245254644 +0000 UTC m=+576.428001532" watchObservedRunningTime="2026-07-07 14:40:14.247250367 +0000 UTC m=+576.429997237" Jul 07 14:40:25.224420 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.224386 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7cfd6cbc88-m48qs" Jul 07 14:40:25.224899 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.224883 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:25.291057 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.291019 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cbbf68f4b-j4w8r"] Jul 07 14:40:25.291267 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.291242 2564 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" podUID="6d6d3b17-7bc2-4bb7-9411-50a66e271cca" containerName="manager" containerID="cri-o://7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca" gracePeriod=30 Jul 07 14:40:25.539642 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.539613 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:25.603007 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.602933 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ckcg\" (UniqueName: \"kubernetes.io/projected/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-kube-api-access-8ckcg\") pod \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " Jul 07 14:40:25.603165 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.603078 2564 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-webhook-cert\") pod \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\" (UID: \"6d6d3b17-7bc2-4bb7-9411-50a66e271cca\") " Jul 07 14:40:25.605228 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.605194 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-kube-api-access-8ckcg" (OuterVolumeSpecName: "kube-api-access-8ckcg") pod "6d6d3b17-7bc2-4bb7-9411-50a66e271cca" (UID: "6d6d3b17-7bc2-4bb7-9411-50a66e271cca"). InnerVolumeSpecName "kube-api-access-8ckcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 07 14:40:25.605336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.605312 2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6d6d3b17-7bc2-4bb7-9411-50a66e271cca" (UID: "6d6d3b17-7bc2-4bb7-9411-50a66e271cca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 07 14:40:25.704602 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.704543 2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ckcg\" (UniqueName: \"kubernetes.io/projected/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-kube-api-access-8ckcg\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:40:25.704602 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:25.704591 2564 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6d6d3b17-7bc2-4bb7-9411-50a66e271cca-webhook-cert\") on node \"ip-10-0-136-116.ec2.internal\" DevicePath \"\"" Jul 07 14:40:26.289355 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.289321 2564 generic.go:356] "Generic (PLEG): container finished" podID="6d6d3b17-7bc2-4bb7-9411-50a66e271cca" containerID="7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca" exitCode=0 Jul 07 14:40:26.289846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.289366 2564 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" Jul 07 14:40:26.289846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.289392 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" event={"ID":"6d6d3b17-7bc2-4bb7-9411-50a66e271cca","Type":"ContainerDied","Data":"7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca"} Jul 07 14:40:26.289846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.289446 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-cbbf68f4b-j4w8r" event={"ID":"6d6d3b17-7bc2-4bb7-9411-50a66e271cca","Type":"ContainerDied","Data":"5ac4693d37dd3143c5b55bd8398ace9133a6183bf8447e1913f7f3005bdc0ce1"} Jul 07 14:40:26.289846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.289481 2564 scope.go:117] "RemoveContainer" containerID="7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca" Jul 07 14:40:26.299024 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.298869 2564 scope.go:117] "RemoveContainer" containerID="7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca" Jul 07 14:40:26.299190 ip-10-0-136-116 kubenswrapper[2564]: E0707 14:40:26.299170 2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca\": container with ID starting with 7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca not found: ID does not exist" containerID="7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca" Jul 07 14:40:26.299236 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.299198 2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca"} err="failed to get container status \"7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca\": rpc error: code = NotFound desc = could not find container \"7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca\": container with ID starting with 7032ff3a16b4689040263e35e05dec399eceaa6bb0d3d3c27429ce5447800aca not found: ID does not exist" Jul 07 14:40:26.310307 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.310274 2564 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-cbbf68f4b-j4w8r"] Jul 07 14:40:26.314290 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.314247 2564 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-cbbf68f4b-j4w8r"] Jul 07 14:40:26.502952 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:40:26.502904 2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6d3b17-7bc2-4bb7-9411-50a66e271cca" path="/var/lib/kubelet/pods/6d6d3b17-7bc2-4bb7-9411-50a66e271cca/volumes" Jul 07 14:50:37.931771 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:37.931740 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8fmlz_fa910f89-bc15-409e-a179-3dcf5c1abcda/manager/0.log" Jul 07 14:50:38.080280 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:38.080251 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cfd6cbc88-m48qs_1ec2d3e5-3836-434a-b54d-3a106104c40a/manager/0.log" Jul 07 14:50:38.208927 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:38.208837 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xckvx_3271759e-b456-42e2-8cbf-8b268c571891/server/0.log" Jul 07 14:50:38.345516 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:38.345493 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zrq9p_492ed262-934b-400f-bcd4-0c507131470a/manager/0.log" Jul 07 14:50:38.483740 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:38.483712 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-4ktqg_a1c691bd-472f-46c6-a74c-32b501a4bc96/copy-manifests/0.log" Jul 07 14:50:38.494891 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:38.494847 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-4ktqg_a1c691bd-472f-46c6-a74c-32b501a4bc96/manager/0.log" Jul 07 14:50:39.899583 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:39.899557 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck_ffcd7a6c-ce56-41b8-a5f9-c64a55566185/util/0.log" Jul 07 14:50:39.908174 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:39.908140 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck_ffcd7a6c-ce56-41b8-a5f9-c64a55566185/pull/0.log" Jul 07 14:50:39.921922 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:39.921898 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck_ffcd7a6c-ce56-41b8-a5f9-c64a55566185/extract/0.log" Jul 07 14:50:40.051653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.051627 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8_4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb/pull/0.log" Jul 07 14:50:40.059447 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.059429 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8_4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb/extract/0.log" Jul 07 14:50:40.067478 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.067461 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8_4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb/util/0.log" Jul 07 14:50:40.216839 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.216758 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k_219060cf-c9af-452b-9cc7-639c101f6c4b/util/0.log" Jul 07 14:50:40.227531 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.227502 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k_219060cf-c9af-452b-9cc7-639c101f6c4b/pull/0.log" Jul 07 14:50:40.238045 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.238019 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k_219060cf-c9af-452b-9cc7-639c101f6c4b/extract/0.log" Jul 07 14:50:40.379513 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.379480 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6_e749ffaa-8f18-4a75-a21e-fe71e5c45b9d/util/0.log" Jul 07 14:50:40.394191 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.394165 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6_e749ffaa-8f18-4a75-a21e-fe71e5c45b9d/pull/0.log" Jul 07 14:50:40.404326 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.404301 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6_e749ffaa-8f18-4a75-a21e-fe71e5c45b9d/extract/0.log" Jul 07 14:50:40.687758 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.687729 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gdjtf_8ee04844-37db-4a7a-8611-be70f4d3ac89/manager/0.log" Jul 07 14:50:40.827235 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.827206 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2rcj6_81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4/manager/0.log" Jul 07 14:50:40.971829 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:40.971805 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6h4sc_a89b5f2b-7dcb-4b29-aecc-abedc7d34539/kuadrant-console-plugin/0.log" Jul 07 14:50:41.096506 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:41.096476 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4khdg_38aaafc5-471f-4ab3-acba-e01bceebf5e6/registry-server/0.log" Jul 07 14:50:41.384302 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:41.384217 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4tvfh_ca68918f-2f24-4b4f-b5da-05af5ef46d29/limitador/0.log" Jul 07 14:50:41.507541 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:41.507513 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qp5gv_9c3df971-760f-4a89-8db8-106e7017146f/manager/0.log" Jul 07 14:50:41.897734 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:41.897703 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wm46c_f14fe716-994d-4ab9-9a2e-6f7a09975e2d/istio-proxy/0.log" Jul 07 14:50:42.174875 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:42.174780 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-9g4xm_37874349-20d7-4524-bba5-1e4aa0955a86/kube-auth-proxy/0.log" Jul 07 14:50:42.430509 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:42.430435 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-c5sbq_bc48c11d-5dfd-4e85-a033-3d362840c69a/istio-proxy/0.log" Jul 07 14:50:47.465969 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.465918 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jxg2k/must-gather-jfx5m"] Jul 07 14:50:47.466504 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.466484 2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6d3b17-7bc2-4bb7-9411-50a66e271cca" containerName="manager" Jul 07 14:50:47.466582 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.466507 2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6d3b17-7bc2-4bb7-9411-50a66e271cca" containerName="manager" Jul 07 14:50:47.466641 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.466629 2564 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6d3b17-7bc2-4bb7-9411-50a66e271cca" containerName="manager" Jul 07 14:50:47.469846 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.469824 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.473463 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.473439 2564 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jxg2k\"/\"default-dockercfg-mzhxt\"" Jul 07 14:50:47.473581 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.473443 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jxg2k\"/\"kube-root-ca.crt\"" Jul 07 14:50:47.473741 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.473727 2564 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jxg2k\"/\"openshift-service-ca.crt\"" Jul 07 14:50:47.520085 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.520047 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jxg2k/must-gather-jfx5m"] Jul 07 14:50:47.535503 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.535465 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zp8vb\" (UniqueName: \"kubernetes.io/projected/6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6-kube-api-access-zp8vb\") pod \"must-gather-jfx5m\" (UID: \"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6\") " pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.535503 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.535501 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6-must-gather-output\") pod \"must-gather-jfx5m\" (UID: \"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6\") " pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.636705 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.636667 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zp8vb\" (UniqueName: \"kubernetes.io/projected/6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6-kube-api-access-zp8vb\") pod \"must-gather-jfx5m\" (UID: \"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6\") " pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.636705 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.636711 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6-must-gather-output\") pod \"must-gather-jfx5m\" (UID: \"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6\") " pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.637081 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.637062 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6-must-gather-output\") pod \"must-gather-jfx5m\" (UID: \"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6\") " pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.649992 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.649965 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zp8vb\" (UniqueName: \"kubernetes.io/projected/6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6-kube-api-access-zp8vb\") pod \"must-gather-jfx5m\" (UID: \"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6\") " pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.779245 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.779198 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jxg2k/must-gather-jfx5m" Jul 07 14:50:47.945208 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.945180 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jxg2k/must-gather-jfx5m"] Jul 07 14:50:47.945674 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:50:47.945651 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6cc4b7ea_cd69_480d_b8bb_562c7da0a8a6.slice/crio-b09c58ecae7da6565bfbdfa322c93e553ce832b8b792eaead7061791c998a374 WatchSource:0}: Error finding container b09c58ecae7da6565bfbdfa322c93e553ce832b8b792eaead7061791c998a374: Status 404 returned error can't find the container with id b09c58ecae7da6565bfbdfa322c93e553ce832b8b792eaead7061791c998a374 Jul 07 14:50:47.947915 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:47.947897 2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 07 14:50:48.568497 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:48.568461 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/must-gather-jfx5m" event={"ID":"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6","Type":"ContainerStarted","Data":"b09c58ecae7da6565bfbdfa322c93e553ce832b8b792eaead7061791c998a374"} Jul 07 14:50:49.578101 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:49.578063 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/must-gather-jfx5m" event={"ID":"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6","Type":"ContainerStarted","Data":"2e19aeb56ac0c34a95cf3876653840ee0ca2639cbf882b0be6edcd60bf7b81ca"} Jul 07 14:50:49.578576 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:49.578110 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/must-gather-jfx5m" event={"ID":"6cc4b7ea-cd69-480d-b8bb-562c7da0a8a6","Type":"ContainerStarted","Data":"2cf0d1b31fe024e90fb054f6661b70a029fc7ece2336e3ac6c8f4cca1dca2bdc"} Jul 07 14:50:49.608910 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:49.608853 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jxg2k/must-gather-jfx5m" podStartSLOduration=1.399254768 podStartE2EDuration="2.608833982s" totalImagesPullingTime="1.209579214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 14:50:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:50:49.607385162 +0000 UTC m=+1211.790132033" watchObservedRunningTime="2026-07-07 14:50:49.608833982 +0000 UTC m=+1211.791580853" Jul 07 14:50:51.063653 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:51.063624 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kq895_f46e0533-6a2b-44aa-aaaf-d95fe0a32be0/global-pull-secret-syncer/0.log" Jul 07 14:50:51.218637 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:51.218601 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-frgw7_853b0783-7a26-4123-b273-4626446e2285/konnectivity-agent/0.log" Jul 07 14:50:51.322894 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:51.322776 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-116.ec2.internal_12c88708317f1b5944d421053e667ab6/haproxy/0.log" Jul 07 14:50:55.814506 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:55.814471 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck_ffcd7a6c-ce56-41b8-a5f9-c64a55566185/extract/0.log" Jul 07 14:50:55.850455 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:55.850415 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck_ffcd7a6c-ce56-41b8-a5f9-c64a55566185/util/0.log" Jul 07 14:50:55.901336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:55.901306 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ckrck_ffcd7a6c-ce56-41b8-a5f9-c64a55566185/pull/0.log" Jul 07 14:50:55.955153 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:55.955123 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8_4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb/extract/0.log" Jul 07 14:50:55.991245 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:55.991219 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8_4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb/util/0.log" Jul 07 14:50:56.032354 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.032328 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0kk5v8_4ceb0a26-f8b0-4bb4-96e2-aca640fb7cfb/pull/0.log" Jul 07 14:50:56.084894 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.084807 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k_219060cf-c9af-452b-9cc7-639c101f6c4b/extract/0.log" Jul 07 14:50:56.119550 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.119526 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k_219060cf-c9af-452b-9cc7-639c101f6c4b/util/0.log" Jul 07 14:50:56.167618 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.167587 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r5n7k_219060cf-c9af-452b-9cc7-639c101f6c4b/pull/0.log" Jul 07 14:50:56.206968 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.206880 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6_e749ffaa-8f18-4a75-a21e-fe71e5c45b9d/extract/0.log" Jul 07 14:50:56.260747 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.260708 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6_e749ffaa-8f18-4a75-a21e-fe71e5c45b9d/util/0.log" Jul 07 14:50:56.304686 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.304657 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kd6p6_e749ffaa-8f18-4a75-a21e-fe71e5c45b9d/pull/0.log" Jul 07 14:50:56.407915 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.407818 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-gdjtf_8ee04844-37db-4a7a-8611-be70f4d3ac89/manager/0.log" Jul 07 14:50:56.441730 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.441704 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2rcj6_81e0488b-e6bd-4a1e-8ecb-6f7e1df6fea4/manager/0.log" Jul 07 14:50:56.493418 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.493394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-6h4sc_a89b5f2b-7dcb-4b29-aecc-abedc7d34539/kuadrant-console-plugin/0.log" Jul 07 14:50:56.559008 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.558964 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-4khdg_38aaafc5-471f-4ab3-acba-e01bceebf5e6/registry-server/0.log" Jul 07 14:50:56.635421 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.635394 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-4tvfh_ca68918f-2f24-4b4f-b5da-05af5ef46d29/limitador/0.log" Jul 07 14:50:56.671042 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:56.670928 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-qp5gv_9c3df971-760f-4a89-8db8-106e7017146f/manager/0.log" Jul 07 14:50:59.079331 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.079302 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-tbxvx_5ad72fb6-1aed-4b62-bfca-808d20a84a0c/kube-state-metrics/0.log" Jul 07 14:50:59.133220 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.133181 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-tbxvx_5ad72fb6-1aed-4b62-bfca-808d20a84a0c/kube-rbac-proxy-main/0.log" Jul 07 14:50:59.207708 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.207676 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-tbxvx_5ad72fb6-1aed-4b62-bfca-808d20a84a0c/kube-rbac-proxy-self/0.log" Jul 07 14:50:59.312336 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.312308 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-775d49d886-tw28k_e733038b-42cf-449d-b034-0eef84ce92e0/metrics-server/0.log" Jul 07 14:50:59.394920 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.394827 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-47v59_b1264afe-bb3a-4f62-8926-13cc45561329/monitoring-plugin/0.log" Jul 07 14:50:59.812515 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.812468 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcggb_9393f8f8-e350-4d43-a744-0b7facbe8812/node-exporter/0.log" Jul 07 14:50:59.853875 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.853846 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcggb_9393f8f8-e350-4d43-a744-0b7facbe8812/kube-rbac-proxy/0.log" Jul 07 14:50:59.897240 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:50:59.897208 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-vcggb_9393f8f8-e350-4d43-a744-0b7facbe8812/init-textfile/0.log" Jul 07 14:51:00.622998 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:00.622964 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d84d4d8d-rpsb2_6b4f846f-91d6-46fc-8d0f-b098f5190242/telemeter-client/0.log" Jul 07 14:51:00.658359 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:00.658323 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d84d4d8d-rpsb2_6b4f846f-91d6-46fc-8d0f-b098f5190242/reload/0.log" Jul 07 14:51:00.693986 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:00.693957 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-77d84d4d8d-rpsb2_6b4f846f-91d6-46fc-8d0f-b098f5190242/kube-rbac-proxy/0.log" Jul 07 14:51:01.066320 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.066279 2564 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w"] Jul 07 14:51:01.073296 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.073262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.085375 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.085341 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w"] Jul 07 14:51:01.174512 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.174472 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-sys\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.174903 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.174531 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-proc\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.174903 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.174638 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-lib-modules\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.174903 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.174702 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-podres\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.174903 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.174783 2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88tqc\" (UniqueName: \"kubernetes.io/projected/4a7e3fef-f973-47d6-ad30-73ad45262f90-kube-api-access-88tqc\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.275844 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.275808 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-podres\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276050 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.275909 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88tqc\" (UniqueName: \"kubernetes.io/projected/4a7e3fef-f973-47d6-ad30-73ad45262f90-kube-api-access-88tqc\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276050 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276006 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-podres\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276050 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276014 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-sys\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276222 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276068 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-sys\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276222 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276093 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-proc\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276222 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276153 2564 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-lib-modules\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276222 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276194 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-proc\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.276382 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.276286 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4a7e3fef-f973-47d6-ad30-73ad45262f90-lib-modules\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.293563 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.293535 2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88tqc\" (UniqueName: \"kubernetes.io/projected/4a7e3fef-f973-47d6-ad30-73ad45262f90-kube-api-access-88tqc\") pod \"perf-node-gather-daemonset-klr7w\" (UID: \"4a7e3fef-f973-47d6-ad30-73ad45262f90\") " pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.393360 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.393262 2564 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:01.576494 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.576468 2564 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w"] Jul 07 14:51:01.579067 ip-10-0-136-116 kubenswrapper[2564]: W0707 14:51:01.578979 2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4a7e3fef_f973_47d6_ad30_73ad45262f90.slice/crio-1625e8bbd182ddf43173887c5ae152d6e03ad0adecafbb11c8e9fcfde0b632e9 WatchSource:0}: Error finding container 1625e8bbd182ddf43173887c5ae152d6e03ad0adecafbb11c8e9fcfde0b632e9: Status 404 returned error can't find the container with id 1625e8bbd182ddf43173887c5ae152d6e03ad0adecafbb11c8e9fcfde0b632e9 Jul 07 14:51:01.688045 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:01.687877 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" event={"ID":"4a7e3fef-f973-47d6-ad30-73ad45262f90","Type":"ContainerStarted","Data":"1625e8bbd182ddf43173887c5ae152d6e03ad0adecafbb11c8e9fcfde0b632e9"} Jul 07 14:51:02.698214 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:02.698159 2564 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" event={"ID":"4a7e3fef-f973-47d6-ad30-73ad45262f90","Type":"ContainerStarted","Data":"e831afa57b7b43d49a9e489fbfbc0c884b1a18ed8989a1a84beb8246280fb947"} Jul 07 14:51:02.699241 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:02.699218 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:02.730731 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:02.730676 2564 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" podStartSLOduration=1.730659861 podStartE2EDuration="1.730659861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 14:51:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 14:51:02.728989074 +0000 UTC m=+1224.911735935" watchObservedRunningTime="2026-07-07 14:51:02.730659861 +0000 UTC m=+1224.913406730" Jul 07 14:51:03.356777 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:03.356750 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56cd85fb6f-phkrp_bfbdd00f-f798-4959-bdbd-5ee0e0ee133b/console/0.log" Jul 07 14:51:05.486377 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:05.486343 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w22js_57562010-e684-4a89-8d5f-a8c536aa93b9/dns/0.log" Jul 07 14:51:05.518291 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:05.518265 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w22js_57562010-e684-4a89-8d5f-a8c536aa93b9/kube-rbac-proxy/0.log" Jul 07 14:51:05.617563 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:05.617536 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pj7xj_0937ba0e-fe91-485f-859b-9b2e83aa6037/dns-node-resolver/0.log" Jul 07 14:51:06.256064 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:06.256013 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-54b78c87fb-cgkjh_c676a4a2-645c-4516-8ae0-e5cbdf51d3d6/registry/0.log" Jul 07 14:51:06.393531 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:06.393506 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p497s_acc2e68a-d850-4802-b0e0-a67a809a0d08/node-ca/0.log" Jul 07 14:51:07.482338 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:07.482270 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wm46c_f14fe716-994d-4ab9-9a2e-6f7a09975e2d/istio-proxy/0.log" Jul 07 14:51:07.553770 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:07.553728 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-9g4xm_37874349-20d7-4524-bba5-1e4aa0955a86/kube-auth-proxy/0.log" Jul 07 14:51:07.671705 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:07.671678 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-c5sbq_bc48c11d-5dfd-4e85-a033-3d362840c69a/istio-proxy/0.log" Jul 07 14:51:08.458366 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:08.458337 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6sfrj_d340be2b-1247-4cb7-a464-71a80a7dac5b/serve-healthcheck-canary/0.log" Jul 07 14:51:09.351384 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:09.351340 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d7kqh_03a7a5d3-cc26-4a79-af4a-915470b2a16e/kube-rbac-proxy/0.log" Jul 07 14:51:09.418210 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:09.418175 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d7kqh_03a7a5d3-cc26-4a79-af4a-915470b2a16e/exporter/0.log" Jul 07 14:51:09.455131 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:09.455095 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d7kqh_03a7a5d3-cc26-4a79-af4a-915470b2a16e/extractor/0.log" Jul 07 14:51:09.723572 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:09.723546 2564 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-jxg2k/perf-node-gather-daemonset-klr7w" Jul 07 14:51:11.710803 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:11.710773 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wm46c_f14fe716-994d-4ab9-9a2e-6f7a09975e2d/istio-proxy/0.log" Jul 07 14:51:11.760469 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:11.760442 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-9g4xm_37874349-20d7-4524-bba5-1e4aa0955a86/kube-auth-proxy/0.log" Jul 07 14:51:11.809854 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:11.809821 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-c5sbq_bc48c11d-5dfd-4e85-a033-3d362840c69a/istio-proxy/0.log" Jul 07 14:51:12.425825 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.425786 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-8fmlz_fa910f89-bc15-409e-a179-3dcf5c1abcda/manager/0.log" Jul 07 14:51:12.468508 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.468478 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7cfd6cbc88-m48qs_1ec2d3e5-3836-434a-b54d-3a106104c40a/manager/0.log" Jul 07 14:51:12.511061 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.511022 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-xckvx_3271759e-b456-42e2-8cbf-8b268c571891/server/0.log" Jul 07 14:51:12.566596 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.566565 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-zrq9p_492ed262-934b-400f-bcd4-0c507131470a/manager/0.log" Jul 07 14:51:12.598592 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.598562 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-4ktqg_a1c691bd-472f-46c6-a74c-32b501a4bc96/manager/0.log" Jul 07 14:51:12.624093 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.624068 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7d7f589f9f-4ktqg_a1c691bd-472f-46c6-a74c-32b501a4bc96/copy-manifests/0.log" Jul 07 14:51:12.942204 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.942171 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678wm46c_f14fe716-994d-4ab9-9a2e-6f7a09975e2d/istio-proxy/0.log" Jul 07 14:51:12.994849 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:12.994812 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-67499f45fb-9g4xm_37874349-20d7-4524-bba5-1e4aa0955a86/kube-auth-proxy/0.log" Jul 07 14:51:13.049775 ip-10-0-136-116 kubenswrapper[2564]: I0707 14:51:13.049741 2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-c5sbq_bc48c11d-5dfd-4e85-a033-3d362840c69a/istio-proxy/0.log"