Jul 06 15:23:38.995523 ip-10-0-134-39 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 06 15:23:38.995532 ip-10-0-134-39 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 06 15:23:38.995539 ip-10-0-134-39 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 06 15:23:38.995769 ip-10-0-134-39 systemd[1]: Failed to start Kubernetes Kubelet. Jul 06 15:23:49.233764 ip-10-0-134-39 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 06 15:23:49.233783 ip-10-0-134-39 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 073fc0ed4fde4bd1bf42bf771c50e735 -- Jul 06 15:25:40.628368 ip-10-0-134-39 systemd[1]: Starting Kubernetes Kubelet... Jul 06 15:25:41.076785 ip-10-0-134-39 systemd[1]: Started Kubernetes Kubelet. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:40.999875 2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003918 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003931 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003937 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003941 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003945 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003949 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:41.092755 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003952 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003954 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003957 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003960 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003963 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003965 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003968 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003970 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003973 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003976 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003978 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003981 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003983 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003986 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003988 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003990 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003994 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003996 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.003999 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:41.099834 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004002 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004005 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004007 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004010 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004013 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004015 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004018 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004021 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004023 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004026 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004028 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004031 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004035 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004037 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004039 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004042 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004044 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004047 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004049 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004052 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:41.100714 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004054 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004057 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004060 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004062 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004065 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004067 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004070 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004072 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004089 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004093 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004095 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004098 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004101 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004104 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004106 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004109 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004112 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004115 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004118 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004121 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:41.101649 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004123 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004126 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004128 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004131 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004133 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004136 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004138 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004141 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004144 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004146 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004149 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004151 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004154 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004156 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004159 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004161 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004164 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004166 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004169 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004172 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:41.102474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004175 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004177 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004180 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004184 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004187 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004189 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004192 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004197 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004200 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004204 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004207 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004210 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004212 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004215 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004889 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004895 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004898 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004901 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004904 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004906 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:41.103474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004909 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004913 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004917 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004920 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004923 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004926 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004929 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004932 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004935 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004938 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004941 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004943 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004947 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004949 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004953 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004955 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004958 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004961 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004963 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004966 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:41.104128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004969 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004972 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004975 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004980 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004983 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004985 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004988 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004990 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004993 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004995 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.004998 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005000 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005003 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005005 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005008 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005010 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005013 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005015 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005018 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:41.104760 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005020 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005023 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005025 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005028 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005030 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005033 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005035 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005038 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005040 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005043 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005045 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005047 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005050 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005053 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005056 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005059 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005061 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005064 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005067 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005070 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:41.105437 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005072 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005091 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005094 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005099 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005102 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005105 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005108 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005111 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005113 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005116 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005119 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005121 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005124 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005126 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005129 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005132 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005135 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005137 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005139 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:41.106572 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005142 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005144 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005147 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005149 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005152 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005155 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005158 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005161 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005164 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005166 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005169 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005173 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005176 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005179 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005182 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005541 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005546 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005549 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005551 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005555 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:41.107404 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005557 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005560 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005563 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005565 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005568 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005570 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005572 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005576 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005579 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005583 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005587 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005591 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005594 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005597 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005599 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005602 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005605 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005608 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005611 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005614 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:41.108060 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005617 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005620 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005623 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005626 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005629 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005631 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005634 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005636 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005638 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005641 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005643 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005646 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005649 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005652 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005654 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005657 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005659 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005664 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005667 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005669 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:41.108688 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005672 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005675 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005677 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005679 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005682 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005684 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005688 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005691 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005703 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005706 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005709 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005712 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005714 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005717 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005720 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005722 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005726 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005729 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005731 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005734 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:41.109957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005736 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005739 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005741 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005744 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005747 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005749 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005752 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005754 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005757 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005764 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005766 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005769 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005771 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005774 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005777 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005779 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005782 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005785 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005787 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005790 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:41.110788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005792 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005795 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005797 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005800 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005802 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005805 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005807 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005810 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005812 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005815 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005818 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005820 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005823 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.005825 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005915 2562 flags.go:64] FLAG: --address="0.0.0.0" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005926 2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005934 2562 flags.go:64] FLAG: --anonymous-auth="true" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005938 2562 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005942 2562 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005947 2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005952 2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 06 15:25:41.111409 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005957 2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005960 2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005963 2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005967 2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005970 2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005973 2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005976 2562 flags.go:64] FLAG: --cgroup-root="" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005979 2562 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005982 2562 flags.go:64] FLAG: --client-ca-file="" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005985 2562 flags.go:64] FLAG: --cloud-provider="external" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005988 2562 flags.go:64] FLAG: --cluster-dns="[]" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005991 2562 flags.go:64] FLAG: --cluster-domain="" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005994 2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.005997 2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006000 2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006003 2562 flags.go:64] FLAG: --container-log-max-files="5" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006007 2562 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006010 2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006013 2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006016 2562 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006019 2562 flags.go:64] FLAG: --contention-profiling="false" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006023 2562 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006026 2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006029 2562 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 06 15:25:41.112023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006032 2562 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006036 2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006039 2562 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006042 2562 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006045 2562 flags.go:64] FLAG: --enable-load-reader="false" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006048 2562 flags.go:64] FLAG: --enable-server="true" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006053 2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006058 2562 flags.go:64] FLAG: --event-burst="100" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006063 2562 flags.go:64] FLAG: --event-qps="50" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006066 2562 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006069 2562 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006072 2562 flags.go:64] FLAG: --eviction-hard="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006092 2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006095 2562 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006098 2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006102 2562 flags.go:64] FLAG: --eviction-soft="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006105 2562 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006108 2562 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006110 2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006113 2562 flags.go:64] FLAG: --experimental-mounter-path="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006116 2562 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006119 2562 flags.go:64] FLAG: --fail-swap-on="true" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006122 2562 flags.go:64] FLAG: --feature-gates="" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006125 2562 flags.go:64] FLAG: --file-check-frequency="20s" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006128 2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 06 15:25:41.112860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006131 2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006134 2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006138 2562 flags.go:64] FLAG: --healthz-port="10248" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006141 2562 flags.go:64] FLAG: --help="false" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006144 2562 flags.go:64] FLAG: --hostname-override="ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006147 2562 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006150 2562 flags.go:64] FLAG: --http-check-frequency="20s" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006153 2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006156 2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006160 2562 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006163 2562 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006166 2562 flags.go:64] FLAG: --image-service-endpoint="" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006168 2562 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006173 2562 flags.go:64] FLAG: --kube-api-burst="100" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006175 2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006180 2562 flags.go:64] FLAG: --kube-api-qps="50" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006183 2562 flags.go:64] FLAG: --kube-reserved="" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006186 2562 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006189 2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006192 2562 flags.go:64] FLAG: --kubelet-cgroups="" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006195 2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006197 2562 flags.go:64] FLAG: --lock-file="" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006200 2562 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006203 2562 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 06 15:25:41.113751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006206 2562 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006211 2562 flags.go:64] FLAG: --log-json-split-stream="false" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006214 2562 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006217 2562 flags.go:64] FLAG: --log-text-split-stream="false" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006219 2562 flags.go:64] FLAG: --logging-format="text" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006223 2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006226 2562 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006228 2562 flags.go:64] FLAG: --manifest-url="" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006231 2562 flags.go:64] FLAG: --manifest-url-header="" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006235 2562 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006238 2562 flags.go:64] FLAG: --max-open-files="1000000" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006242 2562 flags.go:64] FLAG: --max-pods="110" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006245 2562 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006248 2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006251 2562 flags.go:64] FLAG: --memory-manager-policy="None" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006254 2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006257 2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006260 2562 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006263 2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006269 2562 flags.go:64] FLAG: --node-status-max-images="50" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006273 2562 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006277 2562 flags.go:64] FLAG: --oom-score-adj="-999" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006280 2562 flags.go:64] FLAG: --pod-cidr="" Jul 06 15:25:41.114580 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006284 2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006290 2562 flags.go:64] FLAG: --pod-manifest-path="" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006293 2562 flags.go:64] FLAG: --pod-max-pids="-1" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006296 2562 flags.go:64] FLAG: --pods-per-core="0" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006299 2562 flags.go:64] FLAG: --port="10250" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006302 2562 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006305 2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09c60f4886e5f6106" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006308 2562 flags.go:64] FLAG: --qos-reserved="" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006311 2562 flags.go:64] FLAG: --read-only-port="10255" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006314 2562 flags.go:64] FLAG: --register-node="true" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006317 2562 flags.go:64] FLAG: --register-with-taints="" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006320 2562 flags.go:64] FLAG: --registry-burst="10" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006323 2562 flags.go:64] FLAG: --registry-qps="5" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006326 2562 flags.go:64] FLAG: --reserved-cpus="" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006329 2562 flags.go:64] FLAG: --reserved-memory="" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006332 2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006335 2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006338 2562 flags.go:64] FLAG: --rotate-certificates="false" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006341 2562 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006343 2562 flags.go:64] FLAG: --runonce="false" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006346 2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006349 2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006352 2562 flags.go:64] FLAG: --seccomp-default="false" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006355 2562 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006358 2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006361 2562 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 06 15:25:41.251686 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006364 2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006367 2562 flags.go:64] FLAG: --storage-driver-password="root" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006370 2562 flags.go:64] FLAG: --storage-driver-secure="false" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006373 2562 flags.go:64] FLAG: --storage-driver-table="stats" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006376 2562 flags.go:64] FLAG: --storage-driver-user="root" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006380 2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006384 2562 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006387 2562 flags.go:64] FLAG: --system-cgroups="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006389 2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006395 2562 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006398 2562 flags.go:64] FLAG: --tls-cert-file="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006401 2562 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006404 2562 flags.go:64] FLAG: --tls-min-version="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006407 2562 flags.go:64] FLAG: --tls-private-key-file="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006410 2562 flags.go:64] FLAG: --topology-manager-policy="none" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006413 2562 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006416 2562 flags.go:64] FLAG: --topology-manager-scope="container" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006418 2562 flags.go:64] FLAG: --v="2" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006422 2562 flags.go:64] FLAG: --version="false" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006426 2562 flags.go:64] FLAG: --vmodule="" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006429 2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.006432 2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006555 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006558 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:41.274947 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006561 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006564 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006566 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006569 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006571 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006574 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006576 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006580 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006583 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006585 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006588 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006591 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006593 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006597 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006601 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006604 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006607 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006609 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006612 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006614 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:41.275890 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006617 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006620 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006622 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006625 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006628 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006632 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006635 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006638 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006640 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006643 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006646 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006648 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006651 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006653 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006656 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006658 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006661 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006663 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006666 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006668 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:41.277368 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006671 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006674 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006676 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006678 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006681 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006685 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006689 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006692 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006694 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006696 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006699 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006701 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006704 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006707 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006709 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006712 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006714 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006716 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006719 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:41.280412 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006721 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006724 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006727 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006729 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006732 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006734 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006737 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006740 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006742 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006745 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006748 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006750 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006753 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006756 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006759 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006761 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006763 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006766 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006769 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006773 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:41.281015 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006776 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006779 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006783 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006786 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006788 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006791 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006794 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006796 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006799 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006802 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006805 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006807 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006810 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006814 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006818 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006820 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006823 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:41.281691 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.006826 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.007486 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.018097 2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.018112 2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.018779 2562 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.018789 2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018845 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018851 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018854 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018857 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018860 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018863 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018866 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018868 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:41.282233 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018876 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018879 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018882 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018885 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018887 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018890 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018893 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018895 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018898 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018900 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018904 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018906 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018909 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018912 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018914 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018917 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018919 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018922 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018924 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018927 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:41.422843 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018930 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018932 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018935 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018937 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018940 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018943 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018945 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018948 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018951 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018953 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018955 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018958 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018964 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018966 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018969 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018971 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018974 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018977 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018979 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018982 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:41.424000 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018985 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018988 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018990 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018993 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018995 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.018998 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019000 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019003 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019005 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019008 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019011 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019015 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019017 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019021 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019024 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019027 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019030 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019032 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019035 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:41.424666 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019037 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019040 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019042 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019044 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019047 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019052 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019054 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019057 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019060 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019062 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019065 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019068 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019071 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019088 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019091 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019094 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019097 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019099 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019102 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019104 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:41.425237 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019107 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019110 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019112 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019115 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019118 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019120 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019123 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019125 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019128 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019130 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019133 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019136 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.019142 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019251 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 06 15:25:41.425860 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019256 2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019259 2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019262 2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019266 2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019271 2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019274 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019276 2562 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019279 2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019282 2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019284 2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019287 2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019290 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019293 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019296 2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019298 2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019301 2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019304 2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019306 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019309 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019312 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 06 15:25:41.426289 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019314 2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019317 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019319 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019322 2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019324 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019327 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019329 2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019332 2562 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019334 2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019337 2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019340 2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019343 2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019345 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019348 2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019350 2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019354 2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019358 2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019361 2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019363 2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 06 15:25:41.426863 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019366 2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019369 2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019371 2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019374 2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019376 2562 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019380 2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019382 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019385 2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019387 2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019390 2562 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019392 2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019395 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019397 2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019399 2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019402 2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019404 2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019407 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019409 2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019411 2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019414 2562 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 06 15:25:41.427392 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019417 2562 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019419 2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019423 2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019426 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019429 2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019432 2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019435 2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019438 2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019443 2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019448 2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019451 2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019453 2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019456 2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019459 2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019461 2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019464 2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019466 2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019469 2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019472 2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 06 15:25:41.427957 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019475 2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019479 2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019482 2562 feature_gate.go:328] unrecognized feature gate: Example Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019485 2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019488 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019490 2562 feature_gate.go:328] unrecognized feature gate: Example2 Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019493 2562 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019495 2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019498 2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019500 2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019503 2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019505 2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019508 2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019511 2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019513 2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019516 2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019518 2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019521 2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019523 2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 06 15:25:41.428482 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:41.019526 2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.019531 2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.019638 2562 server.go:962] "Client rotation is on, will bootstrap in background" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.021817 2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.023824 2562 server.go:1019] "Starting client certificate rotation" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.023925 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.024737 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.026218 2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.028772 2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.040335 2562 log.go:25] "Validated CRI v1 runtime API" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.043601 2562 log.go:25] "Validated CRI v1 image API" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.048505 2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 06 15:25:41.429029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.052938 2562 fs.go:135] Filesystem UUIDs: map[6a6eab73-0947-4aae-80b5-68d3e9dc182a:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9d08379c-3406-4077-a13f-0f48b1cd6221:/dev/nvme0n1p3] Jul 06 15:25:41.429383 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.052953 2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.059258 2562 manager.go:216] Machine: {Timestamp:2026-07-06 15:25:41.058206707 +0000 UTC m=+0.316412175 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099079 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec250d9db897cf417ca17f5ef3a1ef14 SystemUUID:ec250d9d-b897-cf41-7ca1-7f5ef3a1ef14 BootID:073fc0ed-4fde-4bd1-bf42-bf771c50e735 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:7a:8d:c7:db:bd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:7a:8d:c7:db:bd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:08:e3:0f:54:da Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.059353 2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.059426 2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.060411 2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.060435 2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-39.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.061071 2562 topology_manager.go:138] "Creating topology manager with none policy" Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.061094 2562 container_manager_linux.go:309] "Creating device plugin manager" Jul 06 15:25:41.429483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.061107 2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.061820 2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.062893 2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066555 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066671 2562 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066697 2562 kubelet.go:486] "Attempting to sync node with API server" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066709 2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066731 2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066743 2562 kubelet.go:398] "Adding apiserver pod source" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.066761 2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.067101 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.067119 2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.067921 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.069061 2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.070791 2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.070817 2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071869 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071886 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071895 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071901 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071910 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071915 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071923 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071929 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071935 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071941 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071958 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.071963 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.072745 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.072754 2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.076138 2562 server.go:1268] "Started kubelet" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.077235 2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-39.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.077375 2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.077428 2562 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.077715 2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.078867 2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.079794 2562 server.go:310] "Adding debug handlers to kubelet server" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.081980 2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.085588 2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 06 15:25:41.429776 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.085781 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.085879 2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-39.ec2.internal.18bfbcc72b7cae11 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-39.ec2.internal,UID:ip-10-0-134-39.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-39.ec2.internal,},FirstTimestamp:2026-07-06 15:25:41.076110865 +0000 UTC m=+0.334316329,LastTimestamp:2026-07-06 15:25:41.076110865 +0000 UTC m=+0.334316329,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-39.ec2.internal,}" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.086729 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.087270 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.087405 2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.087730 2562 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.087741 2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.087745 2562 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.087854 2562 reconstruct.go:97] "Volume reconstruction finished" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.087860 2562 reconciler.go:29] "Reconciler: start to sync state" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088054 2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088072 2562 factory.go:55] Registering systemd factory Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088101 2562 factory.go:223] Registration of the systemd container factory successfully Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088310 2562 factory.go:153] Registering CRI-O factory Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088324 2562 factory.go:223] Registration of the crio container factory successfully Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088343 2562 factory.go:103] Registering Raw factory Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088352 2562 manager.go:1196] Started watching for new ooms in manager Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.088651 2562 manager.go:349] Starting recovery of all containers Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.089736 2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.100479 2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-39.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.113372 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8fmm6" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.117853 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8fmm6" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.121991 2562 manager.go:354] Recovery completed Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.133204 2562 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.136148 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.137860 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.137886 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.137896 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.138449 2562 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.138459 2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 06 15:25:41.430825 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.138473 2562 state_mem.go:36] "Initialized new in-memory state store" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.138449 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.139098 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.139137 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.139150 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.140510 2562 policy_none.go:49] "None policy: Start" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.140524 2562 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.140533 2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.142406 2562 policy_none.go:47] "Start" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.187595 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198277 2562 manager.go:337] "Starting Device Plugin manager" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.198303 2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198312 2562 server.go:87] "Starting device plugin registration server" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198550 2562 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198567 2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198654 2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198986 2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.198996 2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.199691 2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.199727 2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.249917 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.251064 2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.251113 2562 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.251131 2562 kubelet.go:2448] "Starting kubelet main sync loop" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.251159 2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.253751 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.305326 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.309067 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.309140 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.309158 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.309182 2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.321575 2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.321590 2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-39.ec2.internal\": node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.344164 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.351490 2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal"] Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.351542 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.352773 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.352796 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.431920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.352808 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.354891 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355010 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355032 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355453 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355472 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355482 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355506 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355524 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.355538 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.357455 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.357479 2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.358028 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientMemory" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.358048 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasNoDiskPressure" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.358060 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeHasSufficientPID" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.386612 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.389732 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.389754 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.389770 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/487ce3ac867cb6a29534fc53f0fccb26-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"487ce3ac867cb6a29534fc53f0fccb26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.433241 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.389772 2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-39.ec2.internal\" not found" node="ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.444696 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.490278 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.490307 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.490325 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/487ce3ac867cb6a29534fc53f0fccb26-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"487ce3ac867cb6a29534fc53f0fccb26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.490354 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/487ce3ac867cb6a29534fc53f0fccb26-config\") pod \"kube-apiserver-proxy-ip-10-0-134-39.ec2.internal\" (UID: \"487ce3ac867cb6a29534fc53f0fccb26\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.490375 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.532794 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.490382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcc7400c82ada97bc7d9b4033908bae2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal\" (UID: \"bcc7400c82ada97bc7d9b4033908bae2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.674517 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.545215 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.674517 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.645545 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.785766 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.689334 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.785766 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:41.692874 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 15:25:41.785766 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.747728 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:41.915761 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.850707 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:42.045895 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:41.952772 2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-39.ec2.internal\" not found" Jul 06 15:25:42.045895 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.006951 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:42.045895 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.023003 2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 06 15:25:42.045895 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.023139 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:25:42.045895 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.024856 2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.066871 2562 apiserver.go:52] "Watching apiserver" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.087932 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.087965 2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.089619 2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.089948 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-dfsds","openshift-multus/network-metrics-daemon-l5b48","openshift-network-diagnostics/network-check-target-7m2gr","kube-system/global-pull-secret-syncer-b682w","kube-system/konnectivity-agent-bt6n5","openshift-cluster-node-tuning-operator/tuned-mwbgh","openshift-dns/node-resolver-6qttk","openshift-network-operator/iptables-alerter-jf7rq","openshift-ovn-kubernetes/ovnkube-node-td5sd","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96","openshift-image-registry/node-ca-zsfkp","openshift-multus/multus-additional-cni-plugins-rstg4"] Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.092523 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.094916 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.094980 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.095298 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.095880 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.096437 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8n44s\"" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.096560 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.096688 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.096838 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.096877 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.101195 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.101235 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.101282 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.104373 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.105409 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.105979 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.106106 2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.107617 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108366 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 06 15:25:42.160100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108400 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108555 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108584 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108629 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108761 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108764 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lnf8z\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.108887 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zg965\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.109338 2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.110059 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.110556 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x6ctp\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.110691 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.111053 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.111104 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.111374 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-hd98q\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.112571 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.113995 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.114211 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.115747 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116228 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116269 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6qfr9\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116463 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116635 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116839 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thn2q\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116865 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116931 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal"] Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.116467 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.117014 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.117059 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.117282 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.118443 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.121021 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6vk5g\"" Jul 06 15:25:42.162100 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.122712 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.123497 2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.123807 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal"] Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.123851 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.123807 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.124230 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.127104 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l4xzg\"" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.133654 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 15:20:42 +0000 UTC" deadline="2028-01-15 08:08:15.415413943 +0000 UTC" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.133691 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13384h42m33.281726082s" Jul 06 15:25:42.163052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.155575 2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.173103 2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xcgpn" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.188699 2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.188824 2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xcgpn" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196441 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-modprobe-d\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196465 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysctl-conf\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53086046-31b4-4f4c-b3f3-d62b1efccf9d-tmp\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196505 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196524 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76fa1b37-81f4-4338-b8f0-74572ebea1c6-host-slash\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196539 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-sys-fs\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196567 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-netns\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196623 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-sys\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-log-socket\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196678 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-env-overrides\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196694 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq6xm\" (UniqueName: \"kubernetes.io/projected/76fa1b37-81f4-4338-b8f0-74572ebea1c6-kube-api-access-gq6xm\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fckdm\" (UniqueName: \"kubernetes.io/projected/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-kube-api-access-fckdm\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.268561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196727 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-cni-bin\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11a9dbca-5f21-4226-85fb-922f1b89d741-agent-certs\") pod \"konnectivity-agent-bt6n5\" (UID: \"11a9dbca-5f21-4226-85fb-922f1b89d741\") " pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196758 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11a9dbca-5f21-4226-85fb-922f1b89d741-konnectivity-ca\") pod \"konnectivity-agent-bt6n5\" (UID: \"11a9dbca-5f21-4226-85fb-922f1b89d741\") " pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196804 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-socket-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196842 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-slash\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196902 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovn-node-metrics-cert\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196923 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-system-cni-dir\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196942 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196958 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysconfig\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.196980 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-run-ovn-kubernetes\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197006 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197023 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovnkube-script-lib\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.271565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197037 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tntks\" (UniqueName: \"kubernetes.io/projected/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-kube-api-access-tntks\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197070 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-k8s-cni-cncf-io\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197113 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-cnibin\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197149 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-host\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197172 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-cni-netd\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197198 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76fa1b37-81f4-4338-b8f0-74572ebea1c6-iptables-alerter-script\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197224 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/681b9f67-3e14-41ed-923f-7bf57a13f161-cni-binary-copy\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-kubernetes\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmhvc\" (UniqueName: \"kubernetes.io/projected/f089a907-8740-47fd-9227-8672829744a1-kube-api-access-nmhvc\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197291 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-serviceca\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197312 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-system-cni-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197347 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-hostroot\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197386 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khj25\" (UniqueName: \"kubernetes.io/projected/53086046-31b4-4f4c-b3f3-d62b1efccf9d-kube-api-access-khj25\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197427 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90e512-7b41-4d33-8937-a814ddb7b3a5-tmp-dir\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.272238 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197452 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197474 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-os-release\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197490 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-cnibin\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197507 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-cni-multus\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197531 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysctl-d\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197545 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-var-lib-kubelet\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197559 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197575 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-registration-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197597 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197611 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-cni-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197625 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-cni-bin\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197657 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-kubelet\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197680 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-kubelet-config\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197695 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-host\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.275674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197718 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-etc-kubernetes\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197743 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197767 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-lib-modules\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197798 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-tuned\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197826 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-dbus\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197844 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-daemon-config\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197869 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bxkk\" (UniqueName: \"kubernetes.io/projected/49eb4904-bf89-4ed9-9907-cc03d24a28ff-kube-api-access-4bxkk\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197915 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-systemd\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197930 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-kubelet\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197955 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-systemd\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.197994 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-etc-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198021 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-var-lib-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198039 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a90e512-7b41-4d33-8937-a814ddb7b3a5-hosts-file\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.276767 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198060 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-systemd-units\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198093 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198123 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198161 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95qfg\" (UniqueName: \"kubernetes.io/projected/254122cb-2808-4ab4-8ae5-9e668f5747b3-kube-api-access-95qfg\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-os-release\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198204 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhkbq\" (UniqueName: \"kubernetes.io/projected/2a90e512-7b41-4d33-8937-a814ddb7b3a5-kube-api-access-lhkbq\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198218 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-node-log\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198232 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-device-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198248 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-conf-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198263 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-multus-certs\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198278 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnmkz\" (UniqueName: \"kubernetes.io/projected/681b9f67-3e14-41ed-923f-7bf57a13f161-kube-api-access-hnmkz\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198292 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-run\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198308 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-run-netns\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198322 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-ovn\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.278198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198336 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovnkube-config\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.279042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.198352 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-socket-dir-parent\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299345 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-dbus\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299394 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-daemon-config\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299431 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bxkk\" (UniqueName: \"kubernetes.io/projected/49eb4904-bf89-4ed9-9907-cc03d24a28ff-kube-api-access-4bxkk\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299440 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-dbus\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299487 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-systemd\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299512 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-kubelet\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-systemd\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-etc-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299595 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-var-lib-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299602 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-etc-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299629 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-systemd\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299635 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-kubelet\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a90e512-7b41-4d33-8937-a814ddb7b3a5-hosts-file\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.380860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299760 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-systemd\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299797 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-systemd-units\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-var-lib-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299822 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95qfg\" (UniqueName: \"kubernetes.io/projected/254122cb-2808-4ab4-8ae5-9e668f5747b3-kube-api-access-95qfg\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299856 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2a90e512-7b41-4d33-8937-a814ddb7b3a5-hosts-file\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299905 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-os-release\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhkbq\" (UniqueName: \"kubernetes.io/projected/2a90e512-7b41-4d33-8937-a814ddb7b3a5-kube-api-access-lhkbq\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.299905 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-systemd-units\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300021 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-os-release\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300074 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-node-log\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300142 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-device-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300155 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-node-log\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-conf-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.381937 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300214 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-conf-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300226 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-multus-certs\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnmkz\" (UniqueName: \"kubernetes.io/projected/681b9f67-3e14-41ed-923f-7bf57a13f161-kube-api-access-hnmkz\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300263 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-run\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-multus-certs\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-device-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300297 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-daemon-config\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-run-netns\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300381 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-run-netns\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300448 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-ovn\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300488 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovnkube-config\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300455 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-run\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300509 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-ovn\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300533 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-socket-dir-parent\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300559 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-modprobe-d\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.384557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300651 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-socket-dir-parent\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300660 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-modprobe-d\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300660 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysctl-conf\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300695 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53086046-31b4-4f4c-b3f3-d62b1efccf9d-tmp\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300713 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76fa1b37-81f4-4338-b8f0-74572ebea1c6-host-slash\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-cni-binary-copy\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300765 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-sys-fs\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300804 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-netns\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300830 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-sys\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300842 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76fa1b37-81f4-4338-b8f0-74572ebea1c6-host-slash\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300959 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-log-socket\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301394 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-netns\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301306 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-log-socket\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301534 2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-sys\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-env-overrides\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301743 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq6xm\" (UniqueName: \"kubernetes.io/projected/76fa1b37-81f4-4338-b8f0-74572ebea1c6-kube-api-access-gq6xm\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301911 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovnkube-config\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301975 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fckdm\" (UniqueName: \"kubernetes.io/projected/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-kube-api-access-fckdm\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.301984 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-sys-fs\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302006 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-cni-bin\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302096 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-cni-bin\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302248 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-env-overrides\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302456 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11a9dbca-5f21-4226-85fb-922f1b89d741-agent-certs\") pod \"konnectivity-agent-bt6n5\" (UID: \"11a9dbca-5f21-4226-85fb-922f1b89d741\") " pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302504 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11a9dbca-5f21-4226-85fb-922f1b89d741-konnectivity-ca\") pod \"konnectivity-agent-bt6n5\" (UID: \"11a9dbca-5f21-4226-85fb-922f1b89d741\") " pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302544 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-socket-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302578 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.385950 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302619 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-slash\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovn-node-metrics-cert\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302690 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-system-cni-dir\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302729 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302761 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysconfig\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302837 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-run-ovn-kubernetes\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302877 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302896 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-slash\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302915 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovnkube-script-lib\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.302978 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tntks\" (UniqueName: \"kubernetes.io/projected/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-kube-api-access-tntks\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303011 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-k8s-cni-cncf-io\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-cnibin\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303193 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-socket-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.386546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-host\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.300832 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysctl-conf\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303888 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/11a9dbca-5f21-4226-85fb-922f1b89d741-konnectivity-ca\") pod \"konnectivity-agent-bt6n5\" (UID: \"11a9dbca-5f21-4226-85fb-922f1b89d741\") " pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303937 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-cni-netd\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.303980 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76fa1b37-81f4-4338-b8f0-74572ebea1c6-iptables-alerter-script\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304016 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/681b9f67-3e14-41ed-923f-7bf57a13f161-cni-binary-copy\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304003 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/254122cb-2808-4ab4-8ae5-9e668f5747b3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304052 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-kubernetes\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304087 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmhvc\" (UniqueName: \"kubernetes.io/projected/f089a907-8740-47fd-9227-8672829744a1-kube-api-access-nmhvc\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304116 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-serviceca\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovnkube-script-lib\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304168 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-system-cni-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304224 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-host\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304243 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-system-cni-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304246 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-system-cni-dir\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304285 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysconfig\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304362 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-hostroot\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.304434 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304523 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khj25\" (UniqueName: \"kubernetes.io/projected/53086046-31b4-4f4c-b3f3-d62b1efccf9d-kube-api-access-khj25\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304560 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90e512-7b41-4d33-8937-a814ddb7b3a5-tmp-dir\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304568 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-run-k8s-cni-cncf-io\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304698 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-cnibin\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.304739 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:42.804595225 +0000 UTC m=+2.062800695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304789 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304823 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-os-release\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304859 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-cnibin\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304889 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/681b9f67-3e14-41ed-923f-7bf57a13f161-cni-binary-copy\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.387992 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304894 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-cni-multus\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304942 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-cni-multus\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304952 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysctl-d\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304996 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-var-lib-kubelet\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305029 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-run-openvswitch\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305034 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305056 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2a90e512-7b41-4d33-8937-a814ddb7b3a5-tmp-dir\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305071 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-registration-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305104 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-cnibin\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.304363 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-run-ovn-kubernetes\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/76fa1b37-81f4-4338-b8f0-74572ebea1c6-iptables-alerter-script\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305478 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-registration-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-host-cni-netd\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-sysctl-d\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.388944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-hostroot\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305613 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-cni-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305650 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-cni-bin\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305671 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305685 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-kubelet\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305725 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-kubelet-config\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305750 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-host\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305781 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-etc-kubernetes\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305786 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f089a907-8740-47fd-9227-8672829744a1-etc-selinux\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305844 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305858 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-etc-kubernetes\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-lib-modules\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.305936 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-tuned\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306041 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-multus-cni-dir\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.306071 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:42.389526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306137 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-cni-bin\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.306288 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:25:42.806254104 +0000 UTC m=+2.064459578 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306376 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/53086046-31b4-4f4c-b3f3-d62b1efccf9d-tmp\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306407 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-var-lib-kubelet\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/681b9f67-3e14-41ed-923f-7bf57a13f161-host-var-lib-kubelet\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306514 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-kubelet-config\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306552 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-kubernetes\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306601 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-host\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.306716 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/53086046-31b4-4f4c-b3f3-d62b1efccf9d-lib-modules\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.307154 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/254122cb-2808-4ab4-8ae5-9e668f5747b3-os-release\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.307319 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-ovn-node-metrics-cert\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.308140 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/11a9dbca-5f21-4226-85fb-922f1b89d741-agent-certs\") pod \"konnectivity-agent-bt6n5\" (UID: \"11a9dbca-5f21-4226-85fb-922f1b89d741\") " pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.308995 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/53086046-31b4-4f4c-b3f3-d62b1efccf9d-etc-tuned\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.309087 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-serviceca\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.310933 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:42.390088 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.310949 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.310960 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.311032 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:42.811009051 +0000 UTC m=+2.069214520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.312865 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bxkk\" (UniqueName: \"kubernetes.io/projected/49eb4904-bf89-4ed9-9907-cc03d24a28ff-kube-api-access-4bxkk\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.317867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq6xm\" (UniqueName: \"kubernetes.io/projected/76fa1b37-81f4-4338-b8f0-74572ebea1c6-kube-api-access-gq6xm\") pod \"iptables-alerter-jf7rq\" (UID: \"76fa1b37-81f4-4338-b8f0-74572ebea1c6\") " pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.317891 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnmkz\" (UniqueName: \"kubernetes.io/projected/681b9f67-3e14-41ed-923f-7bf57a13f161-kube-api-access-hnmkz\") pod \"multus-dfsds\" (UID: \"681b9f67-3e14-41ed-923f-7bf57a13f161\") " pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.318816 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fckdm\" (UniqueName: \"kubernetes.io/projected/1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a-kube-api-access-fckdm\") pod \"node-ca-zsfkp\" (UID: \"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a\") " pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.319063 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95qfg\" (UniqueName: \"kubernetes.io/projected/254122cb-2808-4ab4-8ae5-9e668f5747b3-kube-api-access-95qfg\") pod \"multus-additional-cni-plugins-rstg4\" (UID: \"254122cb-2808-4ab4-8ae5-9e668f5747b3\") " pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.321594 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhkbq\" (UniqueName: \"kubernetes.io/projected/2a90e512-7b41-4d33-8937-a814ddb7b3a5-kube-api-access-lhkbq\") pod \"node-resolver-6qttk\" (UID: \"2a90e512-7b41-4d33-8937-a814ddb7b3a5\") " pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.323688 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tntks\" (UniqueName: \"kubernetes.io/projected/bb9cc9d4-cc74-4c7c-ad1d-0b725a919045-kube-api-access-tntks\") pod \"ovnkube-node-td5sd\" (UID: \"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045\") " pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.323995 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rstg4" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.324159 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-khj25\" (UniqueName: \"kubernetes.io/projected/53086046-31b4-4f4c-b3f3-d62b1efccf9d-kube-api-access-khj25\") pod \"tuned-mwbgh\" (UID: \"53086046-31b4-4f4c-b3f3-d62b1efccf9d\") " pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.325311 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmhvc\" (UniqueName: \"kubernetes.io/projected/f089a907-8740-47fd-9227-8672829744a1-kube-api-access-nmhvc\") pod \"aws-ebs-csi-driver-node-76b96\" (UID: \"f089a907-8740-47fd-9227-8672829744a1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.434238 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc7400c82ada97bc7d9b4033908bae2.slice/crio-4531cf768de67c8bd5852c60be882c5857a40782caf7744abb40df9cb0bb296e WatchSource:0}: Error finding container 4531cf768de67c8bd5852c60be882c5857a40782caf7744abb40df9cb0bb296e: Status 404 returned error can't find the container with id 4531cf768de67c8bd5852c60be882c5857a40782caf7744abb40df9cb0bb296e Jul 06 15:25:42.501715 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.441991 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.450896 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dfsds" Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.460619 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.463189 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod681b9f67_3e14_41ed_923f_7bf57a13f161.slice/crio-fffcc3f56028f72f3d412d9c11c41f7785582e595e21c30ff237e55a2cdb021d WatchSource:0}: Error finding container fffcc3f56028f72f3d412d9c11c41f7785582e595e21c30ff237e55a2cdb021d: Status 404 returned error can't find the container with id fffcc3f56028f72f3d412d9c11c41f7785582e595e21c30ff237e55a2cdb021d Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.463344 2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.469422 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11a9dbca_5f21_4226_85fb_922f1b89d741.slice/crio-38a76f24ce8183c19bb512aa9644382557fd54e26cd09b78c45ee137505e3896 WatchSource:0}: Error finding container 38a76f24ce8183c19bb512aa9644382557fd54e26cd09b78c45ee137505e3896: Status 404 returned error can't find the container with id 38a76f24ce8183c19bb512aa9644382557fd54e26cd09b78c45ee137505e3896 Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.487869 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.495852 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6qttk" Jul 06 15:25:42.504824 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.503650 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53086046_31b4_4f4c_b3f3_d62b1efccf9d.slice/crio-11f7571d574161f8c28fbdb5224c0164f87abf3e952541924a4aced6d52703e6 WatchSource:0}: Error finding container 11f7571d574161f8c28fbdb5224c0164f87abf3e952541924a4aced6d52703e6: Status 404 returned error can't find the container with id 11f7571d574161f8c28fbdb5224c0164f87abf3e952541924a4aced6d52703e6 Jul 06 15:25:42.509160 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.507336 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a90e512_7b41_4d33_8937_a814ddb7b3a5.slice/crio-8730cda41f30b13cdcc8b2097fd55161ba865a78c3974ad03f8057002c36fab1 WatchSource:0}: Error finding container 8730cda41f30b13cdcc8b2097fd55161ba865a78c3974ad03f8057002c36fab1: Status 404 returned error can't find the container with id 8730cda41f30b13cdcc8b2097fd55161ba865a78c3974ad03f8057002c36fab1 Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.533360 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jf7rq" Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.539585 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.542534 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76fa1b37_81f4_4338_b8f0_74572ebea1c6.slice/crio-b4bba3d0d9385e7316a01df5ba0e26e121a0518c15368529e71f4da0c17b15db WatchSource:0}: Error finding container b4bba3d0d9385e7316a01df5ba0e26e121a0518c15368529e71f4da0c17b15db: Status 404 returned error can't find the container with id b4bba3d0d9385e7316a01df5ba0e26e121a0518c15368529e71f4da0c17b15db Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.549752 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb9cc9d4_cc74_4c7c_ad1d_0b725a919045.slice/crio-8104da5dbf7be7b7be2242d862d227215f85d747595c893b58969fa80b6ef7b2 WatchSource:0}: Error finding container 8104da5dbf7be7b7be2242d862d227215f85d747595c893b58969fa80b6ef7b2: Status 404 returned error can't find the container with id 8104da5dbf7be7b7be2242d862d227215f85d747595c893b58969fa80b6ef7b2 Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.566226 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.573221 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zsfkp" Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.575095 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf089a907_8740_47fd_9227_8672829744a1.slice/crio-ce7cda75725d1c7971669b23d65542996f11018d15811defb0a8529fe0be15fd WatchSource:0}: Error finding container ce7cda75725d1c7971669b23d65542996f11018d15811defb0a8529fe0be15fd: Status 404 returned error can't find the container with id ce7cda75725d1c7971669b23d65542996f11018d15811defb0a8529fe0be15fd Jul 06 15:25:42.631150 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.584969 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e00f5ef_8cd2_44f0_8c2d_0ce60f5b086a.slice/crio-ba881bf5cf0d5b2c39c575bf19d8e32302759804d96c39772a5d0787119d05c8 WatchSource:0}: Error finding container ba881bf5cf0d5b2c39c575bf19d8e32302759804d96c39772a5d0787119d05c8: Status 404 returned error can't find the container with id ba881bf5cf0d5b2c39c575bf19d8e32302759804d96c39772a5d0787119d05c8 Jul 06 15:25:42.758684 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:25:42.758662 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254122cb_2808_4ab4_8ae5_9e668f5747b3.slice/crio-1429be9d5ba0aa5e128bdc36f7818a24f9ee31930d4cd35796d9dfa4c7caaf82 WatchSource:0}: Error finding container 1429be9d5ba0aa5e128bdc36f7818a24f9ee31930d4cd35796d9dfa4c7caaf82: Status 404 returned error can't find the container with id 1429be9d5ba0aa5e128bdc36f7818a24f9ee31930d4cd35796d9dfa4c7caaf82 Jul 06 15:25:42.809556 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.809518 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:42.809676 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.809575 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:42.809676 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.809661 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:42.809762 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.809694 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:42.809762 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.809731 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:43.809710897 +0000 UTC m=+3.067916363 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:42.809762 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.809748 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:25:43.809741007 +0000 UTC m=+3.067946464 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:42.910220 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:42.910131 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:42.910433 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.910353 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:42.910433 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.910380 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:42.910433 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.910393 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:42.910614 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:42.910452 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:43.910431728 +0000 UTC m=+3.168637197 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:43.191684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.191416 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:43 +0000 UTC" deadline="2028-02-21 04:48:23.47554518 +0000 UTC" Jul 06 15:25:43.191684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.191459 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14269h22m40.284091083s" Jul 06 15:25:43.267422 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.267354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" event={"ID":"53086046-31b4-4f4c-b3f3-d62b1efccf9d","Type":"ContainerStarted","Data":"11f7571d574161f8c28fbdb5224c0164f87abf3e952541924a4aced6d52703e6"} Jul 06 15:25:43.292621 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.292581 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dfsds" event={"ID":"681b9f67-3e14-41ed-923f-7bf57a13f161","Type":"ContainerStarted","Data":"fffcc3f56028f72f3d412d9c11c41f7785582e595e21c30ff237e55a2cdb021d"} Jul 06 15:25:43.313639 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.313328 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" event={"ID":"487ce3ac867cb6a29534fc53f0fccb26","Type":"ContainerStarted","Data":"9fae44a36a4a8035e188a5e2a61f536e7b131a577b14203fc31e436fc642c49a"} Jul 06 15:25:43.322092 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.322059 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"bcc7400c82ada97bc7d9b4033908bae2","Type":"ContainerStarted","Data":"4531cf768de67c8bd5852c60be882c5857a40782caf7744abb40df9cb0bb296e"} Jul 06 15:25:43.339726 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.339695 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zsfkp" event={"ID":"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a","Type":"ContainerStarted","Data":"ba881bf5cf0d5b2c39c575bf19d8e32302759804d96c39772a5d0787119d05c8"} Jul 06 15:25:43.357097 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.357061 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" event={"ID":"f089a907-8740-47fd-9227-8672829744a1","Type":"ContainerStarted","Data":"ce7cda75725d1c7971669b23d65542996f11018d15811defb0a8529fe0be15fd"} Jul 06 15:25:43.379498 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.379407 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jf7rq" event={"ID":"76fa1b37-81f4-4338-b8f0-74572ebea1c6","Type":"ContainerStarted","Data":"b4bba3d0d9385e7316a01df5ba0e26e121a0518c15368529e71f4da0c17b15db"} Jul 06 15:25:43.383244 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.383217 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bt6n5" event={"ID":"11a9dbca-5f21-4226-85fb-922f1b89d741","Type":"ContainerStarted","Data":"38a76f24ce8183c19bb512aa9644382557fd54e26cd09b78c45ee137505e3896"} Jul 06 15:25:43.407176 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.404966 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerStarted","Data":"1429be9d5ba0aa5e128bdc36f7818a24f9ee31930d4cd35796d9dfa4c7caaf82"} Jul 06 15:25:43.420521 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.420414 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"8104da5dbf7be7b7be2242d862d227215f85d747595c893b58969fa80b6ef7b2"} Jul 06 15:25:43.433924 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.433849 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qttk" event={"ID":"2a90e512-7b41-4d33-8937-a814ddb7b3a5","Type":"ContainerStarted","Data":"8730cda41f30b13cdcc8b2097fd55161ba865a78c3974ad03f8057002c36fab1"} Jul 06 15:25:43.456126 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.455848 2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:43.818035 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.817654 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:43.818035 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.817749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:43.818035 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.817840 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:43.818035 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.817864 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:43.818035 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.817921 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:45.817902071 +0000 UTC m=+5.076107529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:43.818035 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.817942 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:25:45.817930211 +0000 UTC m=+5.076135670 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:43.919141 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:43.918452 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:43.919141 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.918664 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:43.919141 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.918684 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:43.919141 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.918699 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:43.919141 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:43.918762 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:45.918743226 +0000 UTC m=+5.176948686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:44.192700 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:44.192588 2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 15:20:43 +0000 UTC" deadline="2028-02-22 18:31:45.248796821 +0000 UTC" Jul 06 15:25:44.192700 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:44.192647 2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14307h6m1.056154481s" Jul 06 15:25:44.252004 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:44.251968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:44.252226 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:44.252131 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:44.252593 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:44.252573 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:44.252724 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:44.252698 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:44.252788 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:44.252780 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:44.252872 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:44.252852 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:44.340662 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:44.340628 2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 06 15:25:45.837044 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:45.836221 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:45.837044 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:45.836289 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:45.837044 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.836429 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:45.837044 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.836488 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:25:49.83646889 +0000 UTC m=+9.094674345 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:45.837044 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.836904 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:45.837044 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.836960 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:49.836941501 +0000 UTC m=+9.095146960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:45.937627 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:45.937583 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:45.937799 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.937779 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:45.937799 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.937799 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:45.937931 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.937813 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:45.937931 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:45.937874 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:49.937853206 +0000 UTC m=+9.196058675 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:46.251693 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:46.251611 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:46.251863 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:46.251746 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:46.252179 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:46.252142 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:46.252305 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:46.252272 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:46.252305 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:46.252147 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:46.252433 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:46.252394 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:48.251719 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:48.251678 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:48.252236 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:48.251846 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:48.252236 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:48.251966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:48.252236 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:48.252072 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:48.252236 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:48.252080 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:48.252470 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:48.252247 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:49.872120 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:49.871998 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:49.872120 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:49.872089 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:49.872603 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.872241 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:49.872603 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.872313 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:25:57.872293214 +0000 UTC m=+17.130498715 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:49.872603 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.872391 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:49.872603 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.872429 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:25:57.872416056 +0000 UTC m=+17.130621511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:49.973166 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:49.973023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:49.973343 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.973191 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:49.973343 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.973214 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:49.973343 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.973227 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:49.973343 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:49.973291 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:25:57.973271481 +0000 UTC m=+17.231476951 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:50.252342 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:50.252261 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:50.252499 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:50.252401 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:50.252823 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:50.252801 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:50.252950 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:50.252928 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:50.253015 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:50.252980 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:50.253075 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:50.253050 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:52.251857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:52.251774 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:52.251857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:52.251798 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:52.252426 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:52.251923 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:52.252426 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:52.252203 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:52.252426 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:52.252318 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:52.252426 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:52.252414 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:54.251765 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:54.251731 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:54.251765 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:54.251765 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:54.252195 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:54.251745 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:54.252195 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:54.251841 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:54.252195 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:54.251937 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:54.252195 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:54.251990 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:56.251932 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:56.251894 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:56.251932 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:56.251934 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:56.252398 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:56.251935 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:56.252398 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:56.252017 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:56.252398 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:56.252144 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:56.252398 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:56.252240 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:25:57.937822 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:57.937792 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:57.938254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:57.937865 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:57.938254 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:57.937956 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:57.938254 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:57.937965 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:57.938254 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:57.938034 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:26:13.938012524 +0000 UTC m=+33.196217994 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:25:57.938254 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:57.938122 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:13.938094627 +0000 UTC m=+33.196300093 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:25:58.038432 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:58.038393 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:58.038632 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.038575 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:25:58.038632 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.038595 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:25:58.038632 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.038605 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:58.038754 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.038658 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:26:14.038640609 +0000 UTC m=+33.296846061 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:25:58.252368 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:58.252252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:25:58.252368 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:58.252254 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:25:58.252368 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:25:58.252256 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:25:58.252649 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.252429 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:25:58.252649 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.252484 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:25:58.252649 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:25:58.252568 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:00.251844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:00.251805 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:00.252300 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:00.251903 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:00.252300 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:00.251923 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:00.252300 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:00.251915 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:00.252300 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:00.252019 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:00.252300 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:00.252111 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:02.252038 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:02.252003 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:02.252038 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:02.252048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:02.252630 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:02.252043 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:02.252630 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:02.252148 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:02.252630 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:02.252291 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:02.252630 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:02.252391 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:03.487483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:03.487270 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" event={"ID":"53086046-31b4-4f4c-b3f3-d62b1efccf9d","Type":"ContainerStarted","Data":"ac092db08537c4fee279651d8c949ffaff2402a958294b9d0696288dc3c60fc9"} Jul 06 15:26:03.515030 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:03.514856 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mwbgh" podStartSLOduration=0.690404901 podStartE2EDuration="21.514840745s" totalImagesPullingTime="20.824435844s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:03.512992991 +0000 UTC m=+22.771198465" watchObservedRunningTime="2026-07-06 15:26:03.514840745 +0000 UTC m=+22.773046218" Jul 06 15:26:03.521450 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:03.521374 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" event={"ID":"487ce3ac867cb6a29534fc53f0fccb26","Type":"ContainerStarted","Data":"a4b3719cb3c72a2f3b65e0cbe0824b4f493936a7f2ba7c963030e87ac3a500cc"} Jul 06 15:26:03.550984 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:03.550915 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-39.ec2.internal" podStartSLOduration=21.550891365 podStartE2EDuration="21.550891365s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:03.550062777 +0000 UTC m=+22.808268251" watchObservedRunningTime="2026-07-06 15:26:03.550891365 +0000 UTC m=+22.809096840" Jul 06 15:26:04.251944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.251782 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:04.252023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.251834 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:04.252023 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:04.252013 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:04.252121 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.251831 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:04.252154 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:04.252111 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:04.252195 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:04.252180 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:04.533063 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.533036 2562 generic.go:356] "Generic (PLEG): container finished" podID="254122cb-2808-4ab4-8ae5-9e668f5747b3" containerID="a10d86248c538a263a5a365a6705fb91a01bc78ad260e70166508bd0f28c3eb6" exitCode=0 Jul 06 15:26:04.533754 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.533110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerDied","Data":"a10d86248c538a263a5a365a6705fb91a01bc78ad260e70166508bd0f28c3eb6"} Jul 06 15:26:04.536064 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.536033 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"67fecafd1e12d8e03da3d644e4cfce689f370176d69709ac66f3f575bcfca5a9"} Jul 06 15:26:04.536188 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.536126 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"313b458f08e8cca29e20769ca01339ad396897d19672ddb859fea31026d24d81"} Jul 06 15:26:04.536188 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.536172 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"09f12236848520af264c72f95447236e2f86a5d86889cc1d9026b8f641027fc3"} Jul 06 15:26:04.536293 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.536216 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"0c394759020d595ec205675fb661de2b9ed0ee45e54fc4d2f9b720b16f891980"} Jul 06 15:26:04.536335 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.536297 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"3a191381e3d70c5ed293c474909c249abee1e3b5de22688de80f6bb1d15e34cd"} Jul 06 15:26:04.536374 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.536344 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"081657c88e6507fd210f984dc7c942d86ed2420af149e99a6f19b85d4df989a9"} Jul 06 15:26:04.537546 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.537522 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6qttk" event={"ID":"2a90e512-7b41-4d33-8937-a814ddb7b3a5","Type":"ContainerStarted","Data":"d208f7d20aea8d532bc6b341e7a2ae0a02d109eee44961477f25d581682f7420"} Jul 06 15:26:04.538941 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.538923 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dfsds" event={"ID":"681b9f67-3e14-41ed-923f-7bf57a13f161","Type":"ContainerStarted","Data":"14398a027b3dcfb7ec3c886673ed2d413d72d30656feb5205b82db14725de389"} Jul 06 15:26:04.540419 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.540396 2562 generic.go:356] "Generic (PLEG): container finished" podID="bcc7400c82ada97bc7d9b4033908bae2" containerID="1db7439b6ce6314461b4ac4d74cda520bb348e8c88503629a71cdd400f204425" exitCode=0 Jul 06 15:26:04.540523 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.540477 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"bcc7400c82ada97bc7d9b4033908bae2","Type":"ContainerDied","Data":"1db7439b6ce6314461b4ac4d74cda520bb348e8c88503629a71cdd400f204425"} Jul 06 15:26:04.541963 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.541945 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zsfkp" event={"ID":"1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a","Type":"ContainerStarted","Data":"7205406c146a0efa703b779a0842b8aeb5e179c062dc005e84c010ccfe87eba7"} Jul 06 15:26:04.543344 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.543319 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" event={"ID":"f089a907-8740-47fd-9227-8672829744a1","Type":"ContainerStarted","Data":"2b807e26c89d2451ca0fca3f9333335d9adcc80601419c2f64a1f52d64f038e5"} Jul 06 15:26:04.544457 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.544442 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bt6n5" event={"ID":"11a9dbca-5f21-4226-85fb-922f1b89d741","Type":"ContainerStarted","Data":"528cf4e92d61326cb274cc0b5b3952374d3f04576f29fa287ec32de25eacd927"} Jul 06 15:26:04.574427 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.574392 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zsfkp" podStartSLOduration=1.806159107 podStartE2EDuration="22.574378923s" totalImagesPullingTime="20.768219816s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:04.573893469 +0000 UTC m=+23.832098943" watchObservedRunningTime="2026-07-06 15:26:04.574378923 +0000 UTC m=+23.832584397" Jul 06 15:26:04.615123 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.614907 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bt6n5" podStartSLOduration=1.73507546 podStartE2EDuration="22.61489022s" totalImagesPullingTime="20.87981476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:04.592968626 +0000 UTC m=+23.851174099" watchObservedRunningTime="2026-07-06 15:26:04.61489022 +0000 UTC m=+23.873095694" Jul 06 15:26:04.615308 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.615261 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6qttk" podStartSLOduration=1.7658473730000002 podStartE2EDuration="22.615250615s" totalImagesPullingTime="20.849403242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:04.614753932 +0000 UTC m=+23.872959406" watchObservedRunningTime="2026-07-06 15:26:04.615250615 +0000 UTC m=+23.873456089" Jul 06 15:26:04.663625 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:04.663585 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dfsds" podStartSLOduration=1.727794925 podStartE2EDuration="22.663571912s" totalImagesPullingTime="20.935776987s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:04.662705745 +0000 UTC m=+23.920911219" watchObservedRunningTime="2026-07-06 15:26:04.663571912 +0000 UTC m=+23.921777408" Jul 06 15:26:05.549597 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:05.549562 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" event={"ID":"bcc7400c82ada97bc7d9b4033908bae2","Type":"ContainerStarted","Data":"1aaed423f42f8523e1c458772b5b1f3826d07ee1443cf7fef3fbcc78a279b993"} Jul 06 15:26:05.551510 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:05.551480 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jf7rq" event={"ID":"76fa1b37-81f4-4338-b8f0-74572ebea1c6","Type":"ContainerStarted","Data":"e3f6441966f9124d7febb31b15195902b163409cbd5e4cad8b7ebcc015c35623"} Jul 06 15:26:05.569225 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:05.569170 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-39.ec2.internal" podStartSLOduration=23.569152359 podStartE2EDuration="23.569152359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:05.568345203 +0000 UTC m=+24.826550679" watchObservedRunningTime="2026-07-06 15:26:05.569152359 +0000 UTC m=+24.827357833" Jul 06 15:26:05.585475 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:05.585429 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jf7rq" podStartSLOduration=2.805879119 podStartE2EDuration="23.585412909s" totalImagesPullingTime="20.77953379s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:05.585350218 +0000 UTC m=+24.843555693" watchObservedRunningTime="2026-07-06 15:26:05.585412909 +0000 UTC m=+24.843618385" Jul 06 15:26:05.633954 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:05.633929 2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 06 15:26:06.212547 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.211461 2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T15:26:05.633949117Z","UUID":"b642e21f-ce0b-4a37-ad7b-01797749feae","Handler":null,"Name":"","Endpoint":""} Jul 06 15:26:06.214070 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.213879 2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 06 15:26:06.214070 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.213912 2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 06 15:26:06.251519 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.251495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:06.251623 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.251521 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:06.251623 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.251495 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:06.251728 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:06.251607 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:06.251728 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:06.251657 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:06.251728 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:06.251711 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:06.558601 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.558540 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"72b5c13aaf70945c41469b944931d8005dcda38f8d2bd10a4f06a62351440976"} Jul 06 15:26:06.560931 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:06.560862 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" event={"ID":"f089a907-8740-47fd-9227-8672829744a1","Type":"ContainerStarted","Data":"2c8a0685236a3fe63701855f72718372a2f9e00cf704039655e911bc7b9b07ee"} Jul 06 15:26:07.565280 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:07.565245 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" event={"ID":"f089a907-8740-47fd-9227-8672829744a1","Type":"ContainerStarted","Data":"85298a1e230f9291a1f5f9a45b06d281f94b3a08b1e5f4fc0bb96e6c45b3575b"} Jul 06 15:26:07.596900 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:07.596849 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-76b96" podStartSLOduration=2.324744501 podStartE2EDuration="25.596823147s" totalImagesPullingTime="23.272078646s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:07.596741916 +0000 UTC m=+26.854947391" watchObservedRunningTime="2026-07-06 15:26:07.596823147 +0000 UTC m=+26.855028624" Jul 06 15:26:08.251802 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:08.251771 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:08.251995 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:08.251867 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:08.251995 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:08.251870 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:08.251995 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:08.251914 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:08.252190 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:08.252012 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:08.252190 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:08.252108 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:09.473656 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.473452 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:26:09.474237 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.473994 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:26:09.570438 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.570404 2562 generic.go:356] "Generic (PLEG): container finished" podID="254122cb-2808-4ab4-8ae5-9e668f5747b3" containerID="93f1eec5e20c31dfa2ba1c89b05e4a103abaa27cf27e3f7a6e81eba9aea063e2" exitCode=0 Jul 06 15:26:09.570596 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.570485 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerDied","Data":"93f1eec5e20c31dfa2ba1c89b05e4a103abaa27cf27e3f7a6e81eba9aea063e2"} Jul 06 15:26:09.574277 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.574255 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" event={"ID":"bb9cc9d4-cc74-4c7c-ad1d-0b725a919045","Type":"ContainerStarted","Data":"1fb4b714cc6aca17578eac1b57ca574fe08c5b08a189f36f30037587391710a8"} Jul 06 15:26:09.574386 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.574338 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:26:09.574575 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.574497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:26:09.574668 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.574650 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:26:09.574852 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.574838 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:26:09.574951 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.574916 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bt6n5" Jul 06 15:26:09.589269 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.589252 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:26:09.589473 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.589462 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:26:09.659071 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:09.659030 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" podStartSLOduration=6.805206562 podStartE2EDuration="27.659017131s" totalImagesPullingTime="20.853810569s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:09.637643549 +0000 UTC m=+28.895849023" watchObservedRunningTime="2026-07-06 15:26:09.659017131 +0000 UTC m=+28.917222606" Jul 06 15:26:10.251564 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.251533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:10.251842 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.251570 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:10.251842 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.251533 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:10.251842 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:10.251646 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:10.251842 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:10.251765 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:10.251842 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:10.251836 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:10.939592 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.939320 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5b48"] Jul 06 15:26:10.940098 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.939636 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:10.940098 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:10.939754 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:10.940217 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.940145 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b682w"] Jul 06 15:26:10.940259 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.940230 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:10.940342 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:10.940321 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:10.941206 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.941185 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7m2gr"] Jul 06 15:26:10.941319 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:10.941252 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:10.941382 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:10.941332 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:11.579753 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:11.579716 2562 generic.go:356] "Generic (PLEG): container finished" podID="254122cb-2808-4ab4-8ae5-9e668f5747b3" containerID="d5495103a90a942605707c98f3bc936ecfcf53f0a4ac351155ff180e01d15ec4" exitCode=0 Jul 06 15:26:11.579918 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:11.579800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerDied","Data":"d5495103a90a942605707c98f3bc936ecfcf53f0a4ac351155ff180e01d15ec4"} Jul 06 15:26:12.251500 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:12.251471 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:12.251922 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:12.251571 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:13.252071 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:13.252044 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:13.252573 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:13.252195 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:13.252573 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:13.252241 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:13.252573 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:13.252324 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:13.585817 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:13.585790 2562 generic.go:356] "Generic (PLEG): container finished" podID="254122cb-2808-4ab4-8ae5-9e668f5747b3" containerID="b53f5848589bf5b776778ca5287337b3d8271f9aaeb56faeaf12bbeacf2ade91" exitCode=0 Jul 06 15:26:13.585971 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:13.585852 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerDied","Data":"b53f5848589bf5b776778ca5287337b3d8271f9aaeb56faeaf12bbeacf2ade91"} Jul 06 15:26:13.962315 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:13.962234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:13.962315 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:13.962279 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:13.962533 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:13.962375 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:26:13.962533 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:13.962387 2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 06 15:26:13.962533 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:13.962429 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:26:45.962412351 +0000 UTC m=+65.220617805 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 06 15:26:13.962533 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:13.962445 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret podName:5ac4c2f1-72d9-4cf8-b4fc-be695679cef2 nodeName:}" failed. No retries permitted until 2026-07-06 15:26:45.962438931 +0000 UTC m=+65.220644383 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret") pod "global-pull-secret-syncer-b682w" (UID: "5ac4c2f1-72d9-4cf8-b4fc-be695679cef2") : object "kube-system"/"original-pull-secret" not registered Jul 06 15:26:14.062721 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:14.062687 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:14.062875 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:14.062850 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 06 15:26:14.062875 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:14.062866 2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 06 15:26:14.062875 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:14.062875 2562 projected.go:196] Error preparing data for projected volume kube-api-access-4k927 for pod openshift-network-diagnostics/network-check-target-7m2gr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:26:14.063008 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:14.062925 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927 podName:e7feadf5-351b-4a0a-8be7-1a3af456e5fe nodeName:}" failed. No retries permitted until 2026-07-06 15:26:46.062909765 +0000 UTC m=+65.321115235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-4k927" (UniqueName: "kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927") pod "network-check-target-7m2gr" (UID: "e7feadf5-351b-4a0a-8be7-1a3af456e5fe") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 06 15:26:14.252239 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:14.252167 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:14.252628 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:14.252302 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:15.252315 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:15.252231 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:15.252768 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:15.252240 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:15.252768 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:15.252348 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:26:15.252768 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:15.252438 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7m2gr" podUID="e7feadf5-351b-4a0a-8be7-1a3af456e5fe" Jul 06 15:26:16.252049 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:16.252018 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:16.252234 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:16.252154 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b682w" podUID="5ac4c2f1-72d9-4cf8-b4fc-be695679cef2" Jul 06 15:26:17.128391 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.128313 2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-39.ec2.internal" event="NodeReady" Jul 06 15:26:17.128779 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.128459 2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 06 15:26:17.179316 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.179289 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qcqhg"] Jul 06 15:26:17.181878 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.181853 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.183237 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.183210 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xj6dc"] Jul 06 15:26:17.184443 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.184423 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 06 15:26:17.184844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.184824 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.185156 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.185071 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 06 15:26:17.185272 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.185228 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wz98m\"" Jul 06 15:26:17.187092 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.187061 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 06 15:26:17.187177 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.187161 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 06 15:26:17.187223 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.187165 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-np6rm\"" Jul 06 15:26:17.187268 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.187238 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 06 15:26:17.193849 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.193815 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qcqhg"] Jul 06 15:26:17.202602 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.202582 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xj6dc"] Jul 06 15:26:17.251672 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.251601 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:17.251824 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.251607 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:17.254621 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.254595 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:17.254621 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.254608 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:17.255332 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.255313 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:17.255434 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.255420 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqzv9\"" Jul 06 15:26:17.269801 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.269780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cvwwb\"" Jul 06 15:26:17.287709 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.287684 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a004ddc5-9026-4216-bc7b-57d612b66e0a-tmp-dir\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.287810 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.287760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktt75\" (UniqueName: \"kubernetes.io/projected/a004ddc5-9026-4216-bc7b-57d612b66e0a-kube-api-access-ktt75\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.287810 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.287778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7p7s\" (UniqueName: \"kubernetes.io/projected/9f14e1f4-7c54-4267-8025-daec13a60188-kube-api-access-h7p7s\") pod \"ingress-canary-xj6dc\" (UID: \"9f14e1f4-7c54-4267-8025-daec13a60188\") " pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.287902 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.287848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a004ddc5-9026-4216-bc7b-57d612b66e0a-config-volume\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.287902 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.287891 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.287975 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.287916 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f14e1f4-7c54-4267-8025-daec13a60188-cert\") pod \"ingress-canary-xj6dc\" (UID: \"9f14e1f4-7c54-4267-8025-daec13a60188\") " pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.388646 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.388564 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktt75\" (UniqueName: \"kubernetes.io/projected/a004ddc5-9026-4216-bc7b-57d612b66e0a-kube-api-access-ktt75\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.388646 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.388620 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7p7s\" (UniqueName: \"kubernetes.io/projected/9f14e1f4-7c54-4267-8025-daec13a60188-kube-api-access-h7p7s\") pod \"ingress-canary-xj6dc\" (UID: \"9f14e1f4-7c54-4267-8025-daec13a60188\") " pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.388856 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.388684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a004ddc5-9026-4216-bc7b-57d612b66e0a-config-volume\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.388856 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.388721 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.388856 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.388744 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f14e1f4-7c54-4267-8025-daec13a60188-cert\") pod \"ingress-canary-xj6dc\" (UID: \"9f14e1f4-7c54-4267-8025-daec13a60188\") " pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.388856 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.388777 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a004ddc5-9026-4216-bc7b-57d612b66e0a-tmp-dir\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.389044 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:17.388946 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:17.389044 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:17.389013 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:26:17.888992512 +0000 UTC m=+37.147197987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:17.389233 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.389204 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a004ddc5-9026-4216-bc7b-57d612b66e0a-tmp-dir\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.389412 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.389392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a004ddc5-9026-4216-bc7b-57d612b66e0a-config-volume\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.393217 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.393195 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9f14e1f4-7c54-4267-8025-daec13a60188-cert\") pod \"ingress-canary-xj6dc\" (UID: \"9f14e1f4-7c54-4267-8025-daec13a60188\") " pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.398672 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.398648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktt75\" (UniqueName: \"kubernetes.io/projected/a004ddc5-9026-4216-bc7b-57d612b66e0a-kube-api-access-ktt75\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.398829 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.398804 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7p7s\" (UniqueName: \"kubernetes.io/projected/9f14e1f4-7c54-4267-8025-daec13a60188-kube-api-access-h7p7s\") pod \"ingress-canary-xj6dc\" (UID: \"9f14e1f4-7c54-4267-8025-daec13a60188\") " pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.501156 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.501118 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xj6dc" Jul 06 15:26:17.748407 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.748387 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xj6dc"] Jul 06 15:26:17.752659 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:26:17.752581 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f14e1f4_7c54_4267_8025_daec13a60188.slice/crio-675d0025f5244ba051383340a54a4566ce8038b7b4ccd9ee26328557385e653f WatchSource:0}: Error finding container 675d0025f5244ba051383340a54a4566ce8038b7b4ccd9ee26328557385e653f: Status 404 returned error can't find the container with id 675d0025f5244ba051383340a54a4566ce8038b7b4ccd9ee26328557385e653f Jul 06 15:26:17.893623 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:17.893598 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:17.893748 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:17.893730 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:17.893826 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:17.893815 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:26:18.893794865 +0000 UTC m=+38.152000321 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:18.252237 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:18.252204 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:18.255449 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:18.255267 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:18.600815 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:18.600785 2562 generic.go:356] "Generic (PLEG): container finished" podID="254122cb-2808-4ab4-8ae5-9e668f5747b3" containerID="8dd8de6dfbe5370e136185d231098725edfdde5b1af84ba603ea5770533b93a6" exitCode=0 Jul 06 15:26:18.600986 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:18.600872 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerDied","Data":"8dd8de6dfbe5370e136185d231098725edfdde5b1af84ba603ea5770533b93a6"} Jul 06 15:26:18.602221 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:18.602196 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xj6dc" event={"ID":"9f14e1f4-7c54-4267-8025-daec13a60188","Type":"ContainerStarted","Data":"675d0025f5244ba051383340a54a4566ce8038b7b4ccd9ee26328557385e653f"} Jul 06 15:26:18.900271 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:18.900164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:18.900412 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:18.900388 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:18.900479 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:18.900470 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:26:20.900449587 +0000 UTC m=+40.158655045 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:19.607839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:19.607807 2562 generic.go:356] "Generic (PLEG): container finished" podID="254122cb-2808-4ab4-8ae5-9e668f5747b3" containerID="6e203633f178e76560ea9201c4b58273a6d391c9d0e730dddf9ecdb96dbc031a" exitCode=0 Jul 06 15:26:19.608275 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:19.607888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerDied","Data":"6e203633f178e76560ea9201c4b58273a6d391c9d0e730dddf9ecdb96dbc031a"} Jul 06 15:26:20.613796 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:20.613717 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rstg4" event={"ID":"254122cb-2808-4ab4-8ae5-9e668f5747b3","Type":"ContainerStarted","Data":"0f508e88d36c5f242d8cc6fcac3b44b984a8812d794e337e30247d3d85c5bea1"} Jul 06 15:26:20.614966 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:20.614946 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xj6dc" event={"ID":"9f14e1f4-7c54-4267-8025-daec13a60188","Type":"ContainerStarted","Data":"2be0969f0deb8353045bb691b299b49ccb392c0182e16ad232600f39ffb355cd"} Jul 06 15:26:20.643065 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:20.643021 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rstg4" podStartSLOduration=7.662440017 podStartE2EDuration="38.643008129s" totalImagesPullingTime="30.980568112s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:20.641244916 +0000 UTC m=+39.899450405" watchObservedRunningTime="2026-07-06 15:26:20.643008129 +0000 UTC m=+39.901213604" Jul 06 15:26:20.663743 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:20.663700 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xj6dc" podStartSLOduration=1.633656331 podStartE2EDuration="3.663687958s" totalImagesPullingTime="2.030031627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:20.662796022 +0000 UTC m=+39.921001487" watchObservedRunningTime="2026-07-06 15:26:20.663687958 +0000 UTC m=+39.921893464" Jul 06 15:26:20.913069 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:20.913002 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:20.913210 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:20.913153 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:20.913248 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:20.913213 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:26:24.913197813 +0000 UTC m=+44.171403270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:23.601256 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.601220 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs"] Jul 06 15:26:23.632989 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.632968 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.632989 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.632969 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs"] Jul 06 15:26:23.636740 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.636720 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 06 15:26:23.636857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.636747 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 06 15:26:23.637049 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.637032 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ptft2\"" Jul 06 15:26:23.637975 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.637955 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 06 15:26:23.638063 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.637964 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 06 15:26:23.730381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.730357 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a107770-4671-441f-89e8-2667ebd540da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-849fbcb76d-qbtbs\" (UID: \"0a107770-4671-441f-89e8-2667ebd540da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.730476 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.730416 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j98m7\" (UniqueName: \"kubernetes.io/projected/0a107770-4671-441f-89e8-2667ebd540da-kube-api-access-j98m7\") pod \"managed-serviceaccount-addon-agent-849fbcb76d-qbtbs\" (UID: \"0a107770-4671-441f-89e8-2667ebd540da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.830800 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.830772 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j98m7\" (UniqueName: \"kubernetes.io/projected/0a107770-4671-441f-89e8-2667ebd540da-kube-api-access-j98m7\") pod \"managed-serviceaccount-addon-agent-849fbcb76d-qbtbs\" (UID: \"0a107770-4671-441f-89e8-2667ebd540da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.830915 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.830826 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a107770-4671-441f-89e8-2667ebd540da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-849fbcb76d-qbtbs\" (UID: \"0a107770-4671-441f-89e8-2667ebd540da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.834447 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.834425 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/0a107770-4671-441f-89e8-2667ebd540da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-849fbcb76d-qbtbs\" (UID: \"0a107770-4671-441f-89e8-2667ebd540da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.840933 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.840912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j98m7\" (UniqueName: \"kubernetes.io/projected/0a107770-4671-441f-89e8-2667ebd540da-kube-api-access-j98m7\") pod \"managed-serviceaccount-addon-agent-849fbcb76d-qbtbs\" (UID: \"0a107770-4671-441f-89e8-2667ebd540da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:23.954470 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:23.954391 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" Jul 06 15:26:24.096696 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:24.096668 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs"] Jul 06 15:26:24.100115 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:26:24.100072 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a107770_4671_441f_89e8_2667ebd540da.slice/crio-3504515593ae5d5e8fdffa6b04241a6db330072d294c6bd27137f0e22a2d37f2 WatchSource:0}: Error finding container 3504515593ae5d5e8fdffa6b04241a6db330072d294c6bd27137f0e22a2d37f2: Status 404 returned error can't find the container with id 3504515593ae5d5e8fdffa6b04241a6db330072d294c6bd27137f0e22a2d37f2 Jul 06 15:26:24.624466 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:24.624438 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" event={"ID":"0a107770-4671-441f-89e8-2667ebd540da","Type":"ContainerStarted","Data":"3504515593ae5d5e8fdffa6b04241a6db330072d294c6bd27137f0e22a2d37f2"} Jul 06 15:26:24.938986 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:24.938909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:24.939149 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:24.939016 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:24.939149 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:24.939063 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:26:32.939050517 +0000 UTC m=+52.197255969 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:27.633689 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:27.633619 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" event={"ID":"0a107770-4671-441f-89e8-2667ebd540da","Type":"ContainerStarted","Data":"84b4ec4e89e28362882f8ae8e4d6516e93668025a43a39a0dc03452d2bc03315"} Jul 06 15:26:27.661052 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:27.661005 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" podStartSLOduration=1.416650196 podStartE2EDuration="4.660989748s" totalImagesPullingTime="3.244339552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:27.659269213 +0000 UTC m=+46.917474686" watchObservedRunningTime="2026-07-06 15:26:27.660989748 +0000 UTC m=+46.919195221" Jul 06 15:26:32.996503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:32.996466 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:32.996881 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:32.996609 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:32.996881 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:32.996678 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:26:48.996661983 +0000 UTC m=+68.254867436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:41.597095 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:41.597050 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-td5sd" Jul 06 15:26:45.979876 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:45.979819 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:26:45.980405 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:45.979897 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:45.982774 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:45.982753 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 06 15:26:45.982831 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:45.982810 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 06 15:26:45.990919 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:45.990903 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:26:45.990982 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:45.990970 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:27:49.990949956 +0000 UTC m=+129.249155425 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : secret "metrics-daemon-secret" not found Jul 06 15:26:45.992981 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:45.992965 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5ac4c2f1-72d9-4cf8-b4fc-be695679cef2-original-pull-secret\") pod \"global-pull-secret-syncer-b682w\" (UID: \"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2\") " pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:46.080989 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.080949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:46.084047 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.084026 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 06 15:26:46.095058 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.095038 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 06 15:26:46.104713 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.104687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4k927\" (UniqueName: \"kubernetes.io/projected/e7feadf5-351b-4a0a-8be7-1a3af456e5fe-kube-api-access-4k927\") pod \"network-check-target-7m2gr\" (UID: \"e7feadf5-351b-4a0a-8be7-1a3af456e5fe\") " pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:46.162328 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.162307 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b682w" Jul 06 15:26:46.280428 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.280401 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b682w"] Jul 06 15:26:46.283443 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:26:46.283418 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac4c2f1_72d9_4cf8_b4fc_be695679cef2.slice/crio-2435483a53717cda4417525d639021f11ecd7c653745f5b94c72e4e810129379 WatchSource:0}: Error finding container 2435483a53717cda4417525d639021f11ecd7c653745f5b94c72e4e810129379: Status 404 returned error can't find the container with id 2435483a53717cda4417525d639021f11ecd7c653745f5b94c72e4e810129379 Jul 06 15:26:46.372901 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.372874 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gqzv9\"" Jul 06 15:26:46.379701 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.379680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:46.504386 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.504298 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7m2gr"] Jul 06 15:26:46.508623 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:26:46.508598 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7feadf5_351b_4a0a_8be7_1a3af456e5fe.slice/crio-3ea3c38bcbb999c42323bc80d07082ef6e81d44d2772be3430b867de89f99712 WatchSource:0}: Error finding container 3ea3c38bcbb999c42323bc80d07082ef6e81d44d2772be3430b867de89f99712: Status 404 returned error can't find the container with id 3ea3c38bcbb999c42323bc80d07082ef6e81d44d2772be3430b867de89f99712 Jul 06 15:26:46.677182 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.677138 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7m2gr" event={"ID":"e7feadf5-351b-4a0a-8be7-1a3af456e5fe","Type":"ContainerStarted","Data":"3ea3c38bcbb999c42323bc80d07082ef6e81d44d2772be3430b867de89f99712"} Jul 06 15:26:46.678358 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:46.678326 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b682w" event={"ID":"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2","Type":"ContainerStarted","Data":"2435483a53717cda4417525d639021f11ecd7c653745f5b94c72e4e810129379"} Jul 06 15:26:49.000610 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:49.000552 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:26:49.001010 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:49.000747 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:26:49.001010 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:26:49.000829 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:27:21.000806347 +0000 UTC m=+100.259011840 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:26:51.694055 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:51.694022 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b682w" event={"ID":"5ac4c2f1-72d9-4cf8-b4fc-be695679cef2","Type":"ContainerStarted","Data":"44a9345a042f4cd82fbd401259dd0756dcb6e4123c608aa6813a7a2aac18967c"} Jul 06 15:26:51.695392 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:51.695368 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7m2gr" event={"ID":"e7feadf5-351b-4a0a-8be7-1a3af456e5fe","Type":"ContainerStarted","Data":"dcf7c30a9cbd16aaa0f052a3d3afadab8ed632974c27745326dbb56d6b254e6b"} Jul 06 15:26:51.695514 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:51.695497 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:26:51.713031 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:51.712993 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b682w" podStartSLOduration=64.825535213 podStartE2EDuration="1m9.71298072s" totalImagesPullingTime="4.887445507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:51.712150603 +0000 UTC m=+70.970356077" watchObservedRunningTime="2026-07-06 15:26:51.71298072 +0000 UTC m=+70.971186193" Jul 06 15:26:51.730252 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:26:51.730218 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7m2gr" podStartSLOduration=65.078825655 podStartE2EDuration="1m9.730206779s" totalImagesPullingTime="4.651381124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:26:51.729757826 +0000 UTC m=+70.987963300" watchObservedRunningTime="2026-07-06 15:26:51.730206779 +0000 UTC m=+70.988412252" Jul 06 15:27:21.099945 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:21.099899 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:27:21.100414 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:21.100047 2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 06 15:27:21.100414 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:21.100130 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls podName:a004ddc5-9026-4216-bc7b-57d612b66e0a nodeName:}" failed. No retries permitted until 2026-07-06 15:28:25.10011369 +0000 UTC m=+164.358319142 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls") pod "dns-default-qcqhg" (UID: "a004ddc5-9026-4216-bc7b-57d612b66e0a") : secret "dns-default-metrics-tls" not found Jul 06 15:27:22.700182 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:22.700156 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7m2gr" Jul 06 15:27:39.300061 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.300025 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7fc4d6766f-c4lhm"] Jul 06 15:27:39.301928 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.301906 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.305087 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305053 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 06 15:27:39.305339 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305318 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r8xgl\"" Jul 06 15:27:39.305468 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305412 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 06 15:27:39.305468 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305430 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 06 15:27:39.305587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305524 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 06 15:27:39.305587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305557 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 06 15:27:39.305796 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.305782 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 06 15:27:39.317568 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.317542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fc4d6766f-c4lhm"] Jul 06 15:27:39.396540 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.396508 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf"] Jul 06 15:27:39.398411 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.398395 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" Jul 06 15:27:39.401845 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.401823 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:27:39.404854 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.404836 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 06 15:27:39.404941 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.404837 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-sf6jn\"" Jul 06 15:27:39.412421 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.412399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf"] Jul 06 15:27:39.418719 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.418699 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-stats-auth\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.418804 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.418728 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.418804 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.418760 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ctsd\" (UniqueName: \"kubernetes.io/projected/206cc846-ccf8-4013-9dea-edf33f1e01aa-kube-api-access-8ctsd\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.418881 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.418827 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.418881 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.418860 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-default-certificate\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.502223 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.502185 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45"] Jul 06 15:27:39.503973 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.503958 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.506695 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.506674 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-h7nrk\"" Jul 06 15:27:39.506814 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.506785 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 06 15:27:39.506871 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.506818 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 06 15:27:39.507115 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.507098 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 06 15:27:39.507207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.507125 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:27:39.517607 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.517587 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45"] Jul 06 15:27:39.519851 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.519832 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.519964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.519861 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-default-certificate\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.519964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.519893 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-stats-auth\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.519964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.519920 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.519964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.519951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp9mr\" (UniqueName: \"kubernetes.io/projected/39b39418-b74c-457c-a2cd-c8940ff75d8a-kube-api-access-tp9mr\") pod \"volume-data-source-validator-5d456fdbcd-5ftpf\" (UID: \"39b39418-b74c-457c-a2cd-c8940ff75d8a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" Jul 06 15:27:39.520190 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.519992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ctsd\" (UniqueName: \"kubernetes.io/projected/206cc846-ccf8-4013-9dea-edf33f1e01aa-kube-api-access-8ctsd\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.520190 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:39.520033 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:40.020011664 +0000 UTC m=+119.278217118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:39.520300 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:39.520231 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:39.520300 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:39.520287 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:40.020272423 +0000 UTC m=+119.278477887 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : secret "router-metrics-certs-default" not found Jul 06 15:27:39.522476 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.522458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-stats-auth\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.522555 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.522539 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-default-certificate\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.533867 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.533841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ctsd\" (UniqueName: \"kubernetes.io/projected/206cc846-ccf8-4013-9dea-edf33f1e01aa-kube-api-access-8ctsd\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:39.603926 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.603855 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-566d84495b-4wvql"] Jul 06 15:27:39.605710 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.605695 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.609798 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.609780 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 06 15:27:39.609903 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.609840 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 06 15:27:39.610042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.610029 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 06 15:27:39.610346 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.610334 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cp2vf\"" Jul 06 15:27:39.614569 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.614551 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 06 15:27:39.621104 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.621064 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2b7x\" (UniqueName: \"kubernetes.io/projected/1169db0a-0985-41d4-ad95-56b8a98fbbcd-kube-api-access-l2b7x\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.621194 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.621122 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1169db0a-0985-41d4-ad95-56b8a98fbbcd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.621194 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.621146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp9mr\" (UniqueName: \"kubernetes.io/projected/39b39418-b74c-457c-a2cd-c8940ff75d8a-kube-api-access-tp9mr\") pod \"volume-data-source-validator-5d456fdbcd-5ftpf\" (UID: \"39b39418-b74c-457c-a2cd-c8940ff75d8a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" Jul 06 15:27:39.621282 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.621192 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1169db0a-0985-41d4-ad95-56b8a98fbbcd-config\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.622314 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.622297 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-566d84495b-4wvql"] Jul 06 15:27:39.632612 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.632589 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp9mr\" (UniqueName: \"kubernetes.io/projected/39b39418-b74c-457c-a2cd-c8940ff75d8a-kube-api-access-tp9mr\") pod \"volume-data-source-validator-5d456fdbcd-5ftpf\" (UID: \"39b39418-b74c-457c-a2cd-c8940ff75d8a\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" Jul 06 15:27:39.707140 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.707097 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" Jul 06 15:27:39.721764 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.721738 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2b7x\" (UniqueName: \"kubernetes.io/projected/1169db0a-0985-41d4-ad95-56b8a98fbbcd-kube-api-access-l2b7x\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.721861 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.721778 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.721930 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.721909 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1169db0a-0985-41d4-ad95-56b8a98fbbcd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.721974 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.721947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-image-registry-private-configuration\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722025 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.721975 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f98b75de-174a-4882-9ab4-d75dcb7c0e42-ca-trust-extracted\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722025 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.721997 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-certificates\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.722073 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-bound-sa-token\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.722129 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-trusted-ca\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722221 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.722155 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-installation-pull-secrets\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722221 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.722191 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1169db0a-0985-41d4-ad95-56b8a98fbbcd-config\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.722292 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.722226 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmwhs\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-kube-api-access-nmwhs\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.722613 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.722596 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1169db0a-0985-41d4-ad95-56b8a98fbbcd-config\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.724139 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.724115 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1169db0a-0985-41d4-ad95-56b8a98fbbcd-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.734569 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.734549 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2b7x\" (UniqueName: \"kubernetes.io/projected/1169db0a-0985-41d4-ad95-56b8a98fbbcd-kube-api-access-l2b7x\") pod \"service-ca-operator-5d46d9ffd4-thn45\" (UID: \"1169db0a-0985-41d4-ad95-56b8a98fbbcd\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.813130 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.813104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" Jul 06 15:27:39.822699 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.822673 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-trusted-ca\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.822769 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.822716 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-installation-pull-secrets\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.822875 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.822857 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmwhs\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-kube-api-access-nmwhs\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.822951 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.822938 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823005 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.822990 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-image-registry-private-configuration\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823059 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.823028 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f98b75de-174a-4882-9ab4-d75dcb7c0e42-ca-trust-extracted\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823130 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.823054 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-certificates\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823130 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:39.823092 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:27:39.823130 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:39.823113 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-566d84495b-4wvql: secret "image-registry-tls" not found Jul 06 15:27:39.823130 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.823122 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-bound-sa-token\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823317 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:39.823182 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls podName:f98b75de-174a-4882-9ab4-d75dcb7c0e42 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:40.323161429 +0000 UTC m=+119.581366903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls") pod "image-registry-566d84495b-4wvql" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42") : secret "image-registry-tls" not found Jul 06 15:27:39.823481 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.823449 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f98b75de-174a-4882-9ab4-d75dcb7c0e42-ca-trust-extracted\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823745 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.823694 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-certificates\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.823888 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.823867 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-trusted-ca\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.825206 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.825180 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-installation-pull-secrets\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.825483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.825462 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-image-registry-private-configuration\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.829963 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.829940 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf"] Jul 06 15:27:39.833505 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.833483 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-bound-sa-token\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.833596 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:27:39.833500 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39b39418_b74c_457c_a2cd_c8940ff75d8a.slice/crio-e81537d1e8896db63125ab7d27b209b27edbab54f044b8d018e6393dec3d5467 WatchSource:0}: Error finding container e81537d1e8896db63125ab7d27b209b27edbab54f044b8d018e6393dec3d5467: Status 404 returned error can't find the container with id e81537d1e8896db63125ab7d27b209b27edbab54f044b8d018e6393dec3d5467 Jul 06 15:27:39.834193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.834165 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmwhs\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-kube-api-access-nmwhs\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:39.940464 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:39.940436 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45"] Jul 06 15:27:39.943154 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:27:39.943116 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1169db0a_0985_41d4_ad95_56b8a98fbbcd.slice/crio-32802b17a999ff29ac3b5c81adb39601c0cb47aab55558251e598531ca0072cf WatchSource:0}: Error finding container 32802b17a999ff29ac3b5c81adb39601c0cb47aab55558251e598531ca0072cf: Status 404 returned error can't find the container with id 32802b17a999ff29ac3b5c81adb39601c0cb47aab55558251e598531ca0072cf Jul 06 15:27:40.024949 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:40.024922 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:40.025174 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:40.024981 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:40.025174 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:40.025073 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:41.025055925 +0000 UTC m=+120.283261378 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:40.025174 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:40.025092 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:40.025174 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:40.025131 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:41.025123728 +0000 UTC m=+120.283329180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : secret "router-metrics-certs-default" not found Jul 06 15:27:40.326564 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:40.326532 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:40.326925 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:40.326674 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:27:40.326925 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:40.326688 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-566d84495b-4wvql: secret "image-registry-tls" not found Jul 06 15:27:40.326925 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:40.326742 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls podName:f98b75de-174a-4882-9ab4-d75dcb7c0e42 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:41.326724337 +0000 UTC m=+120.584929808 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls") pod "image-registry-566d84495b-4wvql" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42") : secret "image-registry-tls" not found Jul 06 15:27:40.812614 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:40.812574 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" event={"ID":"1169db0a-0985-41d4-ad95-56b8a98fbbcd","Type":"ContainerStarted","Data":"32802b17a999ff29ac3b5c81adb39601c0cb47aab55558251e598531ca0072cf"} Jul 06 15:27:40.813740 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:40.813678 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" event={"ID":"39b39418-b74c-457c-a2cd-c8940ff75d8a","Type":"ContainerStarted","Data":"e81537d1e8896db63125ab7d27b209b27edbab54f044b8d018e6393dec3d5467"} Jul 06 15:27:41.031963 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:41.031923 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:41.032157 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:41.032018 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:41.032157 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:41.032118 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:41.032264 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:41.032179 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:43.032160473 +0000 UTC m=+122.290365927 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:41.032264 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:41.032200 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:43.032190458 +0000 UTC m=+122.290395912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : secret "router-metrics-certs-default" not found Jul 06 15:27:41.333946 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:41.333910 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:41.334404 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:41.334122 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:27:41.334404 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:41.334145 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-566d84495b-4wvql: secret "image-registry-tls" not found Jul 06 15:27:41.334404 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:41.334209 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls podName:f98b75de-174a-4882-9ab4-d75dcb7c0e42 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:43.334187729 +0000 UTC m=+122.592393208 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls") pod "image-registry-566d84495b-4wvql" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42") : secret "image-registry-tls" not found Jul 06 15:27:41.817303 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:41.817269 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" event={"ID":"39b39418-b74c-457c-a2cd-c8940ff75d8a","Type":"ContainerStarted","Data":"f32b6c411cae14ef1e9bcb507cf6980cdc7612989f9c914ad7a2e7087186e20f"} Jul 06 15:27:41.836865 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:41.836824 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-5ftpf" podStartSLOduration=1.85869562 podStartE2EDuration="2.836808084s" totalImagesPullingTime="978.112464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:41.836234466 +0000 UTC m=+121.094439941" watchObservedRunningTime="2026-07-06 15:27:41.836808084 +0000 UTC m=+121.095013557" Jul 06 15:27:42.821489 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:42.821456 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" event={"ID":"1169db0a-0985-41d4-ad95-56b8a98fbbcd","Type":"ContainerStarted","Data":"91c64f6e620ef21eef3ca6761e50ca851c07f4529d78a09fa2e30a3adafab88d"} Jul 06 15:27:42.845377 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:42.845332 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" podStartSLOduration=1.292824014 podStartE2EDuration="3.845316804s" totalImagesPullingTime="2.55249279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:42.844522756 +0000 UTC m=+122.102728231" watchObservedRunningTime="2026-07-06 15:27:42.845316804 +0000 UTC m=+122.103522278" Jul 06 15:27:43.051198 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.051159 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:43.051370 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.051245 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:43.051370 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:43.051293 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:43.051370 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:43.051354 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.051339072 +0000 UTC m=+126.309544524 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : secret "router-metrics-certs-default" not found Jul 06 15:27:43.051370 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:43.051366 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.051360951 +0000 UTC m=+126.309566403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:43.353185 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.353152 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:43.353332 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:43.353292 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:27:43.353332 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:43.353304 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-566d84495b-4wvql: secret "image-registry-tls" not found Jul 06 15:27:43.353401 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:43.353355 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls podName:f98b75de-174a-4882-9ab4-d75dcb7c0e42 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.353338686 +0000 UTC m=+126.611544150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls") pod "image-registry-566d84495b-4wvql" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42") : secret "image-registry-tls" not found Jul 06 15:27:43.833122 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.833097 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-6vkll"] Jul 06 15:27:43.834980 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.834966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:43.837947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.837918 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 06 15:27:43.837947 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.837933 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 06 15:27:43.838192 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.837992 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xh7vl\"" Jul 06 15:27:43.838277 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.838261 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 06 15:27:43.838311 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.838284 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 06 15:27:43.851722 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.851706 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6vkll"] Jul 06 15:27:43.957304 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.957273 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f4db36-bba8-40de-864b-028515b0e377-crio-socket\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:43.957435 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.957365 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7bj8\" (UniqueName: \"kubernetes.io/projected/73f4db36-bba8-40de-864b-028515b0e377-kube-api-access-m7bj8\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:43.957435 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.957401 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:43.957545 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.957525 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:43.957643 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:43.957626 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f4db36-bba8-40de-864b-028515b0e377-data-volume\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.058916 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.058884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f4db36-bba8-40de-864b-028515b0e377-crio-socket\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.059042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.058944 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7bj8\" (UniqueName: \"kubernetes.io/projected/73f4db36-bba8-40de-864b-028515b0e377-kube-api-access-m7bj8\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.059042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.058967 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.059042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.058978 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/73f4db36-bba8-40de-864b-028515b0e377-crio-socket\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.059042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.058992 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.059042 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.059029 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f4db36-bba8-40de-864b-028515b0e377-data-volume\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.059273 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.059057 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:44.059273 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.059139 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:44.559117721 +0000 UTC m=+123.817323176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : configmap "kube-rbac-proxy" not found Jul 06 15:27:44.059273 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.059163 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.059273 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.059201 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:44.55919031 +0000 UTC m=+123.817395778 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.059488 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.059295 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/73f4db36-bba8-40de-864b-028515b0e377-data-volume\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.072354 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.072334 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7bj8\" (UniqueName: \"kubernetes.io/projected/73f4db36-bba8-40de-864b-028515b0e377-kube-api-access-m7bj8\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.563023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.562989 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.563220 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:44.563105 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:44.563220 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.563155 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.563220 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.563172 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:44.563325 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.563223 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:45.563204894 +0000 UTC m=+124.821410346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:44.563325 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:44.563239 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:45.563232782 +0000 UTC m=+124.821438264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : configmap "kube-rbac-proxy" not found Jul 06 15:27:45.571894 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:45.571860 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:45.572390 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:45.571902 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:45.572390 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:45.571980 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:45.572390 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:45.572040 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:45.572390 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:45.572042 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.572026851 +0000 UTC m=+126.830232302 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : configmap "kube-rbac-proxy" not found Jul 06 15:27:45.572390 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:45.572112 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:47.572101161 +0000 UTC m=+126.830306614 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:45.606329 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:45.606302 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qttk_2a90e512-7b41-4d33-8937-a814ddb7b3a5/dns-node-resolver/0.log" Jul 06 15:27:46.176519 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.176485 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq"] Jul 06 15:27:46.178625 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.178609 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" Jul 06 15:27:46.182635 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.182613 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-62bf4\"" Jul 06 15:27:46.191439 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.191416 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq"] Jul 06 15:27:46.278420 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.278385 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkqdm\" (UniqueName: \"kubernetes.io/projected/48ba8c1b-22c5-4611-a871-8a6e23522d7a-kube-api-access-vkqdm\") pod \"network-check-source-989f8b8dc-hcnqq\" (UID: \"48ba8c1b-22c5-4611-a871-8a6e23522d7a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" Jul 06 15:27:46.378970 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.378929 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkqdm\" (UniqueName: \"kubernetes.io/projected/48ba8c1b-22c5-4611-a871-8a6e23522d7a-kube-api-access-vkqdm\") pod \"network-check-source-989f8b8dc-hcnqq\" (UID: \"48ba8c1b-22c5-4611-a871-8a6e23522d7a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" Jul 06 15:27:46.392982 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.392951 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkqdm\" (UniqueName: \"kubernetes.io/projected/48ba8c1b-22c5-4611-a871-8a6e23522d7a-kube-api-access-vkqdm\") pod \"network-check-source-989f8b8dc-hcnqq\" (UID: \"48ba8c1b-22c5-4611-a871-8a6e23522d7a\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" Jul 06 15:27:46.487131 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.487016 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" Jul 06 15:27:46.618834 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.618805 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq"] Jul 06 15:27:46.621842 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:27:46.621818 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48ba8c1b_22c5_4611_a871_8a6e23522d7a.slice/crio-5d60a8b7c86b24bbcb1a1eccfc6e33419f3ea2ffe74dc478b778c13d9e0e06e9 WatchSource:0}: Error finding container 5d60a8b7c86b24bbcb1a1eccfc6e33419f3ea2ffe74dc478b778c13d9e0e06e9: Status 404 returned error can't find the container with id 5d60a8b7c86b24bbcb1a1eccfc6e33419f3ea2ffe74dc478b778c13d9e0e06e9 Jul 06 15:27:46.835897 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.835860 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" event={"ID":"48ba8c1b-22c5-4611-a871-8a6e23522d7a","Type":"ContainerStarted","Data":"f06b93f2ffacfb006342c37f0a6a3d0dcbab7229cad210a279458f3675d441a4"} Jul 06 15:27:46.836064 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.835910 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" event={"ID":"48ba8c1b-22c5-4611-a871-8a6e23522d7a","Type":"ContainerStarted","Data":"5d60a8b7c86b24bbcb1a1eccfc6e33419f3ea2ffe74dc478b778c13d9e0e06e9"} Jul 06 15:27:46.860782 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:46.860733 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-hcnqq" podStartSLOduration=0.860717657 podStartE2EDuration="860.717657ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:46.85964336 +0000 UTC m=+126.117848834" watchObservedRunningTime="2026-07-06 15:27:46.860717657 +0000 UTC m=+126.118923131" Jul 06 15:27:47.000232 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.000199 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zsfkp_1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a/node-ca/0.log" Jul 06 15:27:47.086066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.085997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:47.086066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.086048 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:47.086234 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.086173 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:55.086160655 +0000 UTC m=+134.344366106 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:47.086234 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.086175 2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 06 15:27:47.086302 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.086234 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:27:55.086216834 +0000 UTC m=+134.344422304 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : secret "router-metrics-certs-default" not found Jul 06 15:27:47.388836 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.388749 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:47.388982 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.388904 2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 06 15:27:47.388982 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.388926 2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-566d84495b-4wvql: secret "image-registry-tls" not found Jul 06 15:27:47.388982 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.388982 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls podName:f98b75de-174a-4882-9ab4-d75dcb7c0e42 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:55.388968135 +0000 UTC m=+134.647173587 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls") pod "image-registry-566d84495b-4wvql" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42") : secret "image-registry-tls" not found Jul 06 15:27:47.590157 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.590115 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:47.590157 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.590158 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:47.590345 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.590237 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:47.590345 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.590279 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:47.590345 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.590301 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:51.590286287 +0000 UTC m=+130.848491744 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : configmap "kube-rbac-proxy" not found Jul 06 15:27:47.590345 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:47.590319 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:51.590308872 +0000 UTC m=+130.848514359 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:47.800380 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:47.800354 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xj6dc_9f14e1f4-7c54-4267-8025-daec13a60188/serve-healthcheck-canary/0.log" Jul 06 15:27:50.006655 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:50.006603 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:27:50.007054 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:50.006769 2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 06 15:27:50.007054 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:50.006831 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs podName:49eb4904-bf89-4ed9-9907-cc03d24a28ff nodeName:}" failed. No retries permitted until 2026-07-06 15:29:52.006815221 +0000 UTC m=+251.265020674 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs") pod "network-metrics-daemon-l5b48" (UID: "49eb4904-bf89-4ed9-9907-cc03d24a28ff") : secret "metrics-daemon-secret" not found Jul 06 15:27:51.620509 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:51.620474 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:51.620944 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:51.620517 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:51.620944 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:51.620593 2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 06 15:27:51.620944 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:51.620652 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:51.620944 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:51.620665 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:59.620651299 +0000 UTC m=+138.878856751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : configmap "kube-rbac-proxy" not found Jul 06 15:27:51.620944 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:51.620700 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:27:59.620680442 +0000 UTC m=+138.878885895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:55.147821 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.147767 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:55.148281 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.147949 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:55.148281 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:55.148097 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle podName:206cc846-ccf8-4013-9dea-edf33f1e01aa nodeName:}" failed. No retries permitted until 2026-07-06 15:28:11.148066194 +0000 UTC m=+150.406271646 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle") pod "router-default-7fc4d6766f-c4lhm" (UID: "206cc846-ccf8-4013-9dea-edf33f1e01aa") : configmap references non-existent config key: service-ca.crt Jul 06 15:27:55.150152 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.150135 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/206cc846-ccf8-4013-9dea-edf33f1e01aa-metrics-certs\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:27:55.449981 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.449886 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:55.452257 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.452238 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"image-registry-566d84495b-4wvql\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:55.521664 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.521635 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cp2vf\"" Jul 06 15:27:55.525574 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.525548 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:55.709212 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.709044 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-566d84495b-4wvql"] Jul 06 15:27:55.711473 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:27:55.711438 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf98b75de_174a_4882_9ab4_d75dcb7c0e42.slice/crio-6a8429af3fe5b717ecd99fdab996305037e56c8e534e8b489dd4ef37e7700524 WatchSource:0}: Error finding container 6a8429af3fe5b717ecd99fdab996305037e56c8e534e8b489dd4ef37e7700524: Status 404 returned error can't find the container with id 6a8429af3fe5b717ecd99fdab996305037e56c8e534e8b489dd4ef37e7700524 Jul 06 15:27:55.864030 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.863989 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-566d84495b-4wvql" event={"ID":"f98b75de-174a-4882-9ab4-d75dcb7c0e42","Type":"ContainerStarted","Data":"539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a"} Jul 06 15:27:55.864213 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.864043 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-566d84495b-4wvql" event={"ID":"f98b75de-174a-4882-9ab4-d75dcb7c0e42","Type":"ContainerStarted","Data":"6a8429af3fe5b717ecd99fdab996305037e56c8e534e8b489dd4ef37e7700524"} Jul 06 15:27:55.864213 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.864074 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:27:55.892547 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:55.892501 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-566d84495b-4wvql" podStartSLOduration=16.892486279 podStartE2EDuration="16.892486279s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:27:55.890924016 +0000 UTC m=+135.149129490" watchObservedRunningTime="2026-07-06 15:27:55.892486279 +0000 UTC m=+135.150691761" Jul 06 15:27:59.685162 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:59.685127 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:59.685598 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:59.685217 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:27:59.685598 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:59.685299 2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 06 15:27:59.685598 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:27:59.685375 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls podName:73f4db36-bba8-40de-864b-028515b0e377 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:15.685355826 +0000 UTC m=+154.943561292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls") pod "insights-runtime-extractor-6vkll" (UID: "73f4db36-bba8-40de-864b-028515b0e377") : secret "insights-runtime-extractor-tls" not found Jul 06 15:27:59.685774 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:27:59.685652 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/73f4db36-bba8-40de-864b-028515b0e377-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:28:07.775426 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:07.775395 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-566d84495b-4wvql"] Jul 06 15:28:11.178590 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.178554 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:11.179181 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.179161 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/206cc846-ccf8-4013-9dea-edf33f1e01aa-service-ca-bundle\") pod \"router-default-7fc4d6766f-c4lhm\" (UID: \"206cc846-ccf8-4013-9dea-edf33f1e01aa\") " pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:11.414249 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.414217 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-r8xgl\"" Jul 06 15:28:11.422339 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.422322 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:11.552099 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.552057 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7fc4d6766f-c4lhm"] Jul 06 15:28:11.554779 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:11.554755 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod206cc846_ccf8_4013_9dea_edf33f1e01aa.slice/crio-c958e9396873708652117de908747b9aa956660aea00483272c522c1e4a5b249 WatchSource:0}: Error finding container c958e9396873708652117de908747b9aa956660aea00483272c522c1e4a5b249: Status 404 returned error can't find the container with id c958e9396873708652117de908747b9aa956660aea00483272c522c1e4a5b249 Jul 06 15:28:11.913247 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.913212 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" event={"ID":"206cc846-ccf8-4013-9dea-edf33f1e01aa","Type":"ContainerStarted","Data":"14b7374fc9559ab52d94dc6e50ac69117bc45bbcf2084a1e92d57cdbb37b6a5d"} Jul 06 15:28:11.913436 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.913290 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" event={"ID":"206cc846-ccf8-4013-9dea-edf33f1e01aa","Type":"ContainerStarted","Data":"c958e9396873708652117de908747b9aa956660aea00483272c522c1e4a5b249"} Jul 06 15:28:11.938519 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:11.938467 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" podStartSLOduration=32.938453735 podStartE2EDuration="32.938453735s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:27:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:11.937433778 +0000 UTC m=+151.195639244" watchObservedRunningTime="2026-07-06 15:28:11.938453735 +0000 UTC m=+151.196659209" Jul 06 15:28:12.423506 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:12.423472 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:12.425692 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:12.425668 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:12.916103 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:12.916055 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:12.917273 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:12.917250 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7fc4d6766f-c4lhm" Jul 06 15:28:14.573220 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.573187 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5"] Jul 06 15:28:14.576283 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.576266 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:14.578904 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.578885 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 06 15:28:14.579017 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.579003 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v49sc\"" Jul 06 15:28:14.589722 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.589692 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5"] Jul 06 15:28:14.703142 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.703095 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dksq5\" (UID: \"9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:14.803786 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:14.803748 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dksq5\" (UID: \"9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:14.803948 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:14.803874 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 06 15:28:14.803948 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:14.803929 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56-tls-certificates podName:9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:15.303914488 +0000 UTC m=+154.562119941 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-dksq5" (UID: "9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56") : secret "prometheus-operator-admission-webhook-tls" not found Jul 06 15:28:15.308270 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.308236 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dksq5\" (UID: \"9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:15.310561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.310532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-dksq5\" (UID: \"9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:15.484827 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.484785 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:15.609965 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.609935 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5"] Jul 06 15:28:15.612329 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:15.612299 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9149a512_5a6c_4ddd_9a2e_b9bbe40a3a56.slice/crio-f7ac8b74dc28e5156786b69425aa5198bb0d5c1ef4861b8c737286404c1b059d WatchSource:0}: Error finding container f7ac8b74dc28e5156786b69425aa5198bb0d5c1ef4861b8c737286404c1b059d: Status 404 returned error can't find the container with id f7ac8b74dc28e5156786b69425aa5198bb0d5c1ef4861b8c737286404c1b059d Jul 06 15:28:15.710963 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.710931 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:28:15.713178 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.713160 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/73f4db36-bba8-40de-864b-028515b0e377-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-6vkll\" (UID: \"73f4db36-bba8-40de-864b-028515b0e377\") " pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:28:15.925682 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.925600 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" event={"ID":"9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56","Type":"ContainerStarted","Data":"f7ac8b74dc28e5156786b69425aa5198bb0d5c1ef4861b8c737286404c1b059d"} Jul 06 15:28:15.943891 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:15.943873 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-6vkll" Jul 06 15:28:16.089801 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:16.089730 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-6vkll"] Jul 06 15:28:16.094785 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:16.094757 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73f4db36_bba8_40de_864b_028515b0e377.slice/crio-5eb3f9b48356ee922b403c4cf7884a3bdb6eb92daec12cab4aadf22dc9e9f01d WatchSource:0}: Error finding container 5eb3f9b48356ee922b403c4cf7884a3bdb6eb92daec12cab4aadf22dc9e9f01d: Status 404 returned error can't find the container with id 5eb3f9b48356ee922b403c4cf7884a3bdb6eb92daec12cab4aadf22dc9e9f01d Jul 06 15:28:16.932253 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:16.932162 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vkll" event={"ID":"73f4db36-bba8-40de-864b-028515b0e377","Type":"ContainerStarted","Data":"5eb3f9b48356ee922b403c4cf7884a3bdb6eb92daec12cab4aadf22dc9e9f01d"} Jul 06 15:28:16.933969 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:16.933939 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" event={"ID":"9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56","Type":"ContainerStarted","Data":"e595cc8baeb2878a29c010c0ae6362c1d190b280e227a8d99570470384096f41"} Jul 06 15:28:16.935219 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:16.935151 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:16.941123 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:16.941040 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" Jul 06 15:28:16.954586 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:16.954537 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-dksq5" podStartSLOduration=1.953731294 podStartE2EDuration="2.954517712s" totalImagesPullingTime="1.000786418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:16.953889696 +0000 UTC m=+156.212095170" watchObservedRunningTime="2026-07-06 15:28:16.954517712 +0000 UTC m=+156.212723192" Jul 06 15:28:17.681159 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.681121 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2"] Jul 06 15:28:17.684372 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.684349 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.688611 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.688584 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 06 15:28:17.688734 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.688638 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-7c5b8\"" Jul 06 15:28:17.688734 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.688662 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 06 15:28:17.688832 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.688733 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 06 15:28:17.688832 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.688757 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 06 15:28:17.689064 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.688983 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 06 15:28:17.699575 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.699554 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2"] Jul 06 15:28:17.781628 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.781596 2562 patch_prober.go:28] interesting pod/image-registry-566d84495b-4wvql container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:17.781804 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.781652 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-566d84495b-4wvql" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:17.833871 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.833838 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.833871 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.833870 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.834104 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.833906 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.834104 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.833981 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6fnf\" (UniqueName: \"kubernetes.io/projected/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-kube-api-access-p6fnf\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.934458 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.934377 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.934458 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.934419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.934943 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.934467 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.934943 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.934543 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6fnf\" (UniqueName: \"kubernetes.io/projected/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-kube-api-access-p6fnf\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.935110 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:17.935052 2562 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 06 15:28:17.935110 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.935064 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.935247 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:17.935159 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-tls podName:7cdd2d51-a129-4531-bd1c-6b957ffc1e1d nodeName:}" failed. No retries permitted until 2026-07-06 15:28:18.435138085 +0000 UTC m=+157.693343558 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-skwt2" (UID: "7cdd2d51-a129-4531-bd1c-6b957ffc1e1d") : secret "prometheus-operator-tls" not found Jul 06 15:28:17.937476 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.937452 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:17.945776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:17.945746 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6fnf\" (UniqueName: \"kubernetes.io/projected/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-kube-api-access-p6fnf\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:18.143264 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.143231 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-68d8fcdd78-cn44c"] Jul 06 15:28:18.153473 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.153452 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.156443 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156419 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 15:28:18.156570 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156459 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 15:28:18.156570 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156477 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 15:28:18.156570 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156513 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 15:28:18.156570 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156460 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 15:28:18.156570 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156514 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dr2fb\"" Jul 06 15:28:18.156847 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156727 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 15:28:18.156985 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.156967 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 15:28:18.162689 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.162668 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 15:28:18.163872 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.163850 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d8fcdd78-cn44c"] Jul 06 15:28:18.339163 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339127 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-service-ca\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.339346 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339209 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9gp5\" (UniqueName: \"kubernetes.io/projected/a6a1e386-e14f-4d72-b64a-83c24c255a31-kube-api-access-b9gp5\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.339346 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339244 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-serving-cert\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.339471 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-config\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.339471 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339449 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-oauth-config\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.339579 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339479 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-oauth-serving-cert\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.339579 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.339502 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-trusted-ca-bundle\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.440863 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.440834 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-service-ca\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441049 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.440903 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9gp5\" (UniqueName: \"kubernetes.io/projected/a6a1e386-e14f-4d72-b64a-83c24c255a31-kube-api-access-b9gp5\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441126 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441055 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-serving-cert\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441187 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441153 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:18.441240 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441185 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-config\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441240 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-oauth-config\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441338 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-oauth-serving-cert\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441338 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441297 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-trusted-ca-bundle\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441745 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441687 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-service-ca\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.441872 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-config\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.442197 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.441980 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-oauth-serving-cert\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.442487 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.442454 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-trusted-ca-bundle\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.443913 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.443872 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-oauth-config\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.444218 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.444194 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-serving-cert\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.444410 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.444389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/7cdd2d51-a129-4531-bd1c-6b957ffc1e1d-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-skwt2\" (UID: \"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:18.453300 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.453265 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9gp5\" (UniqueName: \"kubernetes.io/projected/a6a1e386-e14f-4d72-b64a-83c24c255a31-kube-api-access-b9gp5\") pod \"console-68d8fcdd78-cn44c\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.465160 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.465138 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:18.595628 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:18.595551 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" Jul 06 15:28:19.973811 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:19.973787 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2"] Jul 06 15:28:19.976813 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:19.976779 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7cdd2d51_a129_4531_bd1c_6b957ffc1e1d.slice/crio-040397eb5f909edfa005f400d310232ad95169d4d9c692b05016ed48b080c1a9 WatchSource:0}: Error finding container 040397eb5f909edfa005f400d310232ad95169d4d9c692b05016ed48b080c1a9: Status 404 returned error can't find the container with id 040397eb5f909edfa005f400d310232ad95169d4d9c692b05016ed48b080c1a9 Jul 06 15:28:19.990480 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:19.990454 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-68d8fcdd78-cn44c"] Jul 06 15:28:19.993474 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:19.993443 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6a1e386_e14f_4d72_b64a_83c24c255a31.slice/crio-e590c09fd02bd6067346d6c0e736d29758423c2c0cbd4b13a6a5f327118317d3 WatchSource:0}: Error finding container e590c09fd02bd6067346d6c0e736d29758423c2c0cbd4b13a6a5f327118317d3: Status 404 returned error can't find the container with id e590c09fd02bd6067346d6c0e736d29758423c2c0cbd4b13a6a5f327118317d3 Jul 06 15:28:20.194259 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:20.194172 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-qcqhg" podUID="a004ddc5-9026-4216-bc7b-57d612b66e0a" Jul 06 15:28:20.263587 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:20.263551 2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-l5b48" podUID="49eb4904-bf89-4ed9-9907-cc03d24a28ff" Jul 06 15:28:20.951258 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:20.951173 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vkll" event={"ID":"73f4db36-bba8-40de-864b-028515b0e377","Type":"ContainerStarted","Data":"9db932733db72d0b1675e5230a4090a68319df9f4a1d3c099b5af6ff85af65b2"} Jul 06 15:28:20.951258 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:20.951243 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vkll" event={"ID":"73f4db36-bba8-40de-864b-028515b0e377","Type":"ContainerStarted","Data":"cf8d1a55e5ef77dc46e5a3c74bf62743c06b041aa2e509fe865570a257679e74"} Jul 06 15:28:20.952810 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:20.952778 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" event={"ID":"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d","Type":"ContainerStarted","Data":"040397eb5f909edfa005f400d310232ad95169d4d9c692b05016ed48b080c1a9"} Jul 06 15:28:20.954290 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:20.954250 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d8fcdd78-cn44c" event={"ID":"a6a1e386-e14f-4d72-b64a-83c24c255a31","Type":"ContainerStarted","Data":"e590c09fd02bd6067346d6c0e736d29758423c2c0cbd4b13a6a5f327118317d3"} Jul 06 15:28:20.954392 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:20.954275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcqhg" Jul 06 15:28:21.960069 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:21.959961 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" event={"ID":"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d","Type":"ContainerStarted","Data":"12cdfb3c038b4833db1d96951866c07eecf483d824a225eeff34a0dfe0dc6d11"} Jul 06 15:28:21.960069 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:21.960035 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" event={"ID":"7cdd2d51-a129-4531-bd1c-6b957ffc1e1d","Type":"ContainerStarted","Data":"aad4505ff62d0d8ea98e6a9e8bea729d996e96678ea8f23f00d1f79ed11f26e0"} Jul 06 15:28:21.985864 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:21.985814 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-skwt2" podStartSLOduration=3.666101597 podStartE2EDuration="4.985793288s" totalImagesPullingTime="1.319691691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:21.984158639 +0000 UTC m=+161.242364113" watchObservedRunningTime="2026-07-06 15:28:21.985793288 +0000 UTC m=+161.243998764" Jul 06 15:28:24.174263 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.174229 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wpv6x"] Jul 06 15:28:24.178037 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.178000 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.180577 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.180555 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 06 15:28:24.180813 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.180796 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 06 15:28:24.181061 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.181045 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 06 15:28:24.181129 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.181099 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rgg4q\"" Jul 06 15:28:24.182964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.182941 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-root\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183047 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.182991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183133 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183053 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-textfile\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183133 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183105 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-metrics-client-ca\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183133 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183128 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-sys\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183262 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183151 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183262 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-tls\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183262 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-wtmp\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.183422 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.183269 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghlvg\" (UniqueName: \"kubernetes.io/projected/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-kube-api-access-ghlvg\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.283766 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.283735 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-sys\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.283929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.283775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.283929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.283827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-tls\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.283929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.283838 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-sys\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.283929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.283868 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-wtmp\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284124 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:24.283953 2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 06 15:28:24.284124 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.283997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghlvg\" (UniqueName: \"kubernetes.io/projected/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-kube-api-access-ghlvg\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284124 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:24.284009 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-tls podName:b19788b5-7ce4-47b0-95c7-e8854f6ca2f3 nodeName:}" failed. No retries permitted until 2026-07-06 15:28:24.783992669 +0000 UTC m=+164.042198153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-tls") pod "node-exporter-wpv6x" (UID: "b19788b5-7ce4-47b0-95c7-e8854f6ca2f3") : secret "node-exporter-tls" not found Jul 06 15:28:24.284124 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284000 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-wtmp\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284124 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-root\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284313 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284150 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284313 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284166 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-root\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284313 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284201 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-textfile\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284313 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284242 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-metrics-client-ca\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284585 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284564 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-textfile\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284784 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-metrics-client-ca\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.284821 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.284764 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.286066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.286050 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.295922 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.295902 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghlvg\" (UniqueName: \"kubernetes.io/projected/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-kube-api-access-ghlvg\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.788980 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.788950 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-tls\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.791122 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.791102 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b19788b5-7ce4-47b0-95c7-e8854f6ca2f3-node-exporter-tls\") pod \"node-exporter-wpv6x\" (UID: \"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3\") " pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:24.971675 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.971638 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-6vkll" event={"ID":"73f4db36-bba8-40de-864b-028515b0e377","Type":"ContainerStarted","Data":"cb9c0ce587a18f5986281b762e7fc9614b499c01a12c844c1163a5d01a70623e"} Jul 06 15:28:24.973174 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.973144 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d8fcdd78-cn44c" event={"ID":"a6a1e386-e14f-4d72-b64a-83c24c255a31","Type":"ContainerStarted","Data":"44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e"} Jul 06 15:28:24.997208 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:24.997168 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-6vkll" podStartSLOduration=34.165912812 podStartE2EDuration="41.99715396s" totalImagesPullingTime="7.831241148s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:27:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:24.995811069 +0000 UTC m=+164.254016544" watchObservedRunningTime="2026-07-06 15:28:24.99715396 +0000 UTC m=+164.255359434" Jul 06 15:28:25.024716 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.024667 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-68d8fcdd78-cn44c" podStartSLOduration=2.966670613 podStartE2EDuration="7.024652157s" totalImagesPullingTime="4.057981544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:25.023022529 +0000 UTC m=+164.281228003" watchObservedRunningTime="2026-07-06 15:28:25.024652157 +0000 UTC m=+164.282857630" Jul 06 15:28:25.087611 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.087553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wpv6x" Jul 06 15:28:25.098700 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:25.098679 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19788b5_7ce4_47b0_95c7_e8854f6ca2f3.slice/crio-a2e286d26a8329f82e65ff923aab36e1c86b5e98a5c58871bed656f6567f2d8d WatchSource:0}: Error finding container a2e286d26a8329f82e65ff923aab36e1c86b5e98a5c58871bed656f6567f2d8d: Status 404 returned error can't find the container with id a2e286d26a8329f82e65ff923aab36e1c86b5e98a5c58871bed656f6567f2d8d Jul 06 15:28:25.192523 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.192494 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:28:25.194800 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.194781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a004ddc5-9026-4216-bc7b-57d612b66e0a-metrics-tls\") pod \"dns-default-qcqhg\" (UID: \"a004ddc5-9026-4216-bc7b-57d612b66e0a\") " pod="openshift-dns/dns-default-qcqhg" Jul 06 15:28:25.458368 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.458299 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wz98m\"" Jul 06 15:28:25.466665 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.466648 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qcqhg" Jul 06 15:28:25.602738 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.602704 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qcqhg"] Jul 06 15:28:25.605694 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:25.605663 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda004ddc5_9026_4216_bc7b_57d612b66e0a.slice/crio-9a34dc0fa27fd85663f34c479972f5714527f0a6067ccf50b46c5fff697e5df8 WatchSource:0}: Error finding container 9a34dc0fa27fd85663f34c479972f5714527f0a6067ccf50b46c5fff697e5df8: Status 404 returned error can't find the container with id 9a34dc0fa27fd85663f34c479972f5714527f0a6067ccf50b46c5fff697e5df8 Jul 06 15:28:25.977419 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.977389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qcqhg" event={"ID":"a004ddc5-9026-4216-bc7b-57d612b66e0a","Type":"ContainerStarted","Data":"9a34dc0fa27fd85663f34c479972f5714527f0a6067ccf50b46c5fff697e5df8"} Jul 06 15:28:25.978451 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:25.978424 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpv6x" event={"ID":"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3","Type":"ContainerStarted","Data":"a2e286d26a8329f82e65ff923aab36e1c86b5e98a5c58871bed656f6567f2d8d"} Jul 06 15:28:26.988395 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:26.988352 2562 generic.go:356] "Generic (PLEG): container finished" podID="b19788b5-7ce4-47b0-95c7-e8854f6ca2f3" containerID="d01b3891d9608678fd4863ab941a2e922fc125a13fb0eb510e7acfbb98cd26f3" exitCode=0 Jul 06 15:28:26.988823 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:26.988406 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpv6x" event={"ID":"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3","Type":"ContainerDied","Data":"d01b3891d9608678fd4863ab941a2e922fc125a13fb0eb510e7acfbb98cd26f3"} Jul 06 15:28:27.197851 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.197828 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-55748799f9-sxqh9"] Jul 06 15:28:27.202702 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.202680 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.205749 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.205728 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 06 15:28:27.205851 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.205783 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2bs66egt1bfpp\"" Jul 06 15:28:27.205851 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.205841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 06 15:28:27.205948 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.205841 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-rwmxg\"" Jul 06 15:28:27.206137 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.206119 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 06 15:28:27.206226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.206209 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 06 15:28:27.208363 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.208344 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 06 15:28:27.226136 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.226110 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55748799f9-sxqh9"] Jul 06 15:28:27.313980 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.313947 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.313991 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-tls\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.314013 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f23597-d2d9-4def-949e-d3a688fe90a6-metrics-client-ca\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.314047 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.314065 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314245 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.314114 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314276 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.314240 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-grpc-tls\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.314308 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.314275 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk6v9\" (UniqueName: \"kubernetes.io/projected/e3f23597-d2d9-4def-949e-d3a688fe90a6-kube-api-access-kk6v9\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415019 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.414985 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-grpc-tls\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415019 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415023 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk6v9\" (UniqueName: \"kubernetes.io/projected/e3f23597-d2d9-4def-949e-d3a688fe90a6-kube-api-access-kk6v9\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415056 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415096 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-tls\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415118 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f23597-d2d9-4def-949e-d3a688fe90a6-metrics-client-ca\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415148 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415171 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415209 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.415976 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.415925 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e3f23597-d2d9-4def-949e-d3a688fe90a6-metrics-client-ca\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.417916 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.417890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.418036 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.417890 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.418151 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.418131 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-grpc-tls\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.418205 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.418168 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-tls\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.418251 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.418233 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.418359 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.418344 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e3f23597-d2d9-4def-949e-d3a688fe90a6-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.424524 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.424504 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk6v9\" (UniqueName: \"kubernetes.io/projected/e3f23597-d2d9-4def-949e-d3a688fe90a6-kube-api-access-kk6v9\") pod \"thanos-querier-55748799f9-sxqh9\" (UID: \"e3f23597-d2d9-4def-949e-d3a688fe90a6\") " pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.531282 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.531260 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:27.668742 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.668704 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-55748799f9-sxqh9"] Jul 06 15:28:27.672217 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:27.672192 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f23597_d2d9_4def_949e_d3a688fe90a6.slice/crio-8d661b953047a1d3172f33e3eb72dbc70ea23450e1132e94678c830f3e6e3e6b WatchSource:0}: Error finding container 8d661b953047a1d3172f33e3eb72dbc70ea23450e1132e94678c830f3e6e3e6b: Status 404 returned error can't find the container with id 8d661b953047a1d3172f33e3eb72dbc70ea23450e1132e94678c830f3e6e3e6b Jul 06 15:28:27.779787 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.779709 2562 patch_prober.go:28] interesting pod/image-registry-566d84495b-4wvql container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 06 15:28:27.779787 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.779764 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-566d84495b-4wvql" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:28:27.992801 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.992757 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"8d661b953047a1d3172f33e3eb72dbc70ea23450e1132e94678c830f3e6e3e6b"} Jul 06 15:28:27.994153 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.994127 2562 generic.go:356] "Generic (PLEG): container finished" podID="0a107770-4671-441f-89e8-2667ebd540da" containerID="84b4ec4e89e28362882f8ae8e4d6516e93668025a43a39a0dc03452d2bc03315" exitCode=255 Jul 06 15:28:27.994254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.994207 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" event={"ID":"0a107770-4671-441f-89e8-2667ebd540da","Type":"ContainerDied","Data":"84b4ec4e89e28362882f8ae8e4d6516e93668025a43a39a0dc03452d2bc03315"} Jul 06 15:28:27.998272 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.998247 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qcqhg" event={"ID":"a004ddc5-9026-4216-bc7b-57d612b66e0a","Type":"ContainerStarted","Data":"2b0cc0d1a5d41bff12eb6f129eadf5c7c37b341483358ef6c5dc2bbfca6386a7"} Jul 06 15:28:27.998386 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.998296 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qcqhg" event={"ID":"a004ddc5-9026-4216-bc7b-57d612b66e0a","Type":"ContainerStarted","Data":"c3a69edd9070cb74f54edd67f2907c2d2201f82d5c27c3ba7032d1c06b62c93b"} Jul 06 15:28:27.998386 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:27.998327 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qcqhg" Jul 06 15:28:28.000792 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.000771 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpv6x" event={"ID":"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3","Type":"ContainerStarted","Data":"d4cce4bd0cb3d9d4412c04b415d65b9d9852586c5dbcb2c855ff9364eb0eca8b"} Jul 06 15:28:28.000892 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.000814 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wpv6x" event={"ID":"b19788b5-7ce4-47b0-95c7-e8854f6ca2f3","Type":"ContainerStarted","Data":"7c6d5bc8bbee876b804bbbab3361ad32672b8130aafbd65bba7d77a6c4eb6c40"} Jul 06 15:28:28.001526 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.001512 2562 scope.go:117] "RemoveContainer" containerID="84b4ec4e89e28362882f8ae8e4d6516e93668025a43a39a0dc03452d2bc03315" Jul 06 15:28:28.038266 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.038215 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qcqhg" podStartSLOduration=129.49407804 podStartE2EDuration="2m11.038194794s" totalImagesPullingTime="1.544116754s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:26:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:28.036853326 +0000 UTC m=+167.295058800" watchObservedRunningTime="2026-07-06 15:28:28.038194794 +0000 UTC m=+167.296400269" Jul 06 15:28:28.063408 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.063353 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wpv6x" podStartSLOduration=3.097532349 podStartE2EDuration="4.063332598s" totalImagesPullingTime="898.295407ms" totalInitContainerRuntime="67.504842ms" isStatefulPod=true podCreationTimestamp="2026-07-06 15:28:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:28.062201369 +0000 UTC m=+167.320406842" watchObservedRunningTime="2026-07-06 15:28:28.063332598 +0000 UTC m=+167.321538073" Jul 06 15:28:28.466310 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.466229 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:28.466310 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.466280 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:28.467842 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.467806 2562 patch_prober.go:28] interesting pod/console-68d8fcdd78-cn44c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jul 06 15:28:28.467957 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.467858 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-68d8fcdd78-cn44c" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jul 06 15:28:28.698406 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.698374 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5466568bf7-6jhxm"] Jul 06 15:28:28.702001 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.701981 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.704750 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.704733 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 06 15:28:28.705787 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.705760 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 06 15:28:28.705875 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.705832 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-85q625l12moiq\"" Jul 06 15:28:28.705917 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.705895 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 06 15:28:28.705955 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.705938 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 06 15:28:28.706066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.706051 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-d7bzk\"" Jul 06 15:28:28.713882 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.713861 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5466568bf7-6jhxm"] Jul 06 15:28:28.727709 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727644 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0386a46f-e06b-4224-b149-ba586c27421e-metrics-server-audit-profiles\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.727810 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727712 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fd7ln\" (UniqueName: \"kubernetes.io/projected/0386a46f-e06b-4224-b149-ba586c27421e-kube-api-access-fd7ln\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.727810 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727756 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-secret-metrics-server-client-certs\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.727924 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727907 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-secret-metrics-server-tls\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.727982 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727937 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0386a46f-e06b-4224-b149-ba586c27421e-audit-log\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.727982 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-client-ca-bundle\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.728069 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.727989 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0386a46f-e06b-4224-b149-ba586c27421e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828470 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828435 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-secret-metrics-server-tls\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828649 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828499 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0386a46f-e06b-4224-b149-ba586c27421e-audit-log\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828649 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828616 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-client-ca-bundle\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828780 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828657 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0386a46f-e06b-4224-b149-ba586c27421e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828780 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828706 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0386a46f-e06b-4224-b149-ba586c27421e-metrics-server-audit-profiles\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828780 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828742 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fd7ln\" (UniqueName: \"kubernetes.io/projected/0386a46f-e06b-4224-b149-ba586c27421e-kube-api-access-fd7ln\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828962 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828775 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-secret-metrics-server-client-certs\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.828962 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.828845 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/0386a46f-e06b-4224-b149-ba586c27421e-audit-log\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.829556 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.829532 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0386a46f-e06b-4224-b149-ba586c27421e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.830136 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.830093 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/0386a46f-e06b-4224-b149-ba586c27421e-metrics-server-audit-profiles\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.831544 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.831506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-secret-metrics-server-tls\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.831777 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.831581 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-secret-metrics-server-client-certs\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.832251 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.832223 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/0386a46f-e06b-4224-b149-ba586c27421e-client-ca-bundle\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.839789 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.839763 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fd7ln\" (UniqueName: \"kubernetes.io/projected/0386a46f-e06b-4224-b149-ba586c27421e-kube-api-access-fd7ln\") pod \"metrics-server-5466568bf7-6jhxm\" (UID: \"0386a46f-e06b-4224-b149-ba586c27421e\") " pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:28.848869 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.848845 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm"] Jul 06 15:28:28.853350 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.853331 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:28.857147 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.857129 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 06 15:28:28.857250 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.857199 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-kxzcp\"" Jul 06 15:28:28.867584 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.867565 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm"] Jul 06 15:28:28.930157 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.930130 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bcb51d9f-f249-4d41-af00-4d9ba9eda120-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7cftm\" (UID: \"bcb51d9f-f249-4d41-af00-4d9ba9eda120\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:28.930318 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.930182 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrct2\" (UniqueName: \"kubernetes.io/projected/bcb51d9f-f249-4d41-af00-4d9ba9eda120-kube-api-access-rrct2\") pod \"monitoring-plugin-d5dcff7cf-7cftm\" (UID: \"bcb51d9f-f249-4d41-af00-4d9ba9eda120\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:28.946638 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.946610 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54fb47ddb8-wkfqh"] Jul 06 15:28:28.949685 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:28.949670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.008047 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.007965 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-849fbcb76d-qbtbs" event={"ID":"0a107770-4671-441f-89e8-2667ebd540da","Type":"ContainerStarted","Data":"f30f97259f816a17fdf5f3f697157fe699ce60e90a2d4f2a1971b9141147452b"} Jul 06 15:28:29.010886 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.010866 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:29.024685 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.024660 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fb47ddb8-wkfqh"] Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041526 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-config\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041568 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-serving-cert\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041599 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-service-ca\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041693 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrct2\" (UniqueName: \"kubernetes.io/projected/bcb51d9f-f249-4d41-af00-4d9ba9eda120-kube-api-access-rrct2\") pod \"monitoring-plugin-d5dcff7cf-7cftm\" (UID: \"bcb51d9f-f249-4d41-af00-4d9ba9eda120\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041736 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwl7n\" (UniqueName: \"kubernetes.io/projected/51d2622e-5830-42f0-9e20-7e0b4377bffc-kube-api-access-mwl7n\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041820 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-oauth-serving-cert\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041848 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-oauth-config\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041895 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-trusted-ca-bundle\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.042455 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.041997 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bcb51d9f-f249-4d41-af00-4d9ba9eda120-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7cftm\" (UID: \"bcb51d9f-f249-4d41-af00-4d9ba9eda120\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:29.054412 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.054389 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bcb51d9f-f249-4d41-af00-4d9ba9eda120-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-7cftm\" (UID: \"bcb51d9f-f249-4d41-af00-4d9ba9eda120\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:29.061651 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.061627 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrct2\" (UniqueName: \"kubernetes.io/projected/bcb51d9f-f249-4d41-af00-4d9ba9eda120-kube-api-access-rrct2\") pod \"monitoring-plugin-d5dcff7cf-7cftm\" (UID: \"bcb51d9f-f249-4d41-af00-4d9ba9eda120\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:29.142920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.142827 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-config\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.142920 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.142873 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-serving-cert\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.143288 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.143258 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-service-ca\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.143371 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.143339 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwl7n\" (UniqueName: \"kubernetes.io/projected/51d2622e-5830-42f0-9e20-7e0b4377bffc-kube-api-access-mwl7n\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.143430 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.143401 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-oauth-serving-cert\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.143481 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.143429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-oauth-config\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.143481 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.143465 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-trusted-ca-bundle\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.144405 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.144337 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-oauth-serving-cert\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.144684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.144620 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-config\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.144828 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.144799 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-service-ca\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.144935 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.144912 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-trusted-ca-bundle\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.146296 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.146254 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-oauth-config\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.146799 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.146779 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-serving-cert\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.156963 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.156930 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwl7n\" (UniqueName: \"kubernetes.io/projected/51d2622e-5830-42f0-9e20-7e0b4377bffc-kube-api-access-mwl7n\") pod \"console-54fb47ddb8-wkfqh\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.164723 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.164686 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:29.181506 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.181484 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5466568bf7-6jhxm"] Jul 06 15:28:29.258924 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.258850 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:29.736753 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.736674 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54fb47ddb8-wkfqh"] Jul 06 15:28:29.739871 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:29.739847 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51d2622e_5830_42f0_9e20_7e0b4377bffc.slice/crio-04ed7f6fa3b8b64fc688e9e5ba920ee0cfec8785f9cb5e96147c422669d8944a WatchSource:0}: Error finding container 04ed7f6fa3b8b64fc688e9e5ba920ee0cfec8785f9cb5e96147c422669d8944a: Status 404 returned error can't find the container with id 04ed7f6fa3b8b64fc688e9e5ba920ee0cfec8785f9cb5e96147c422669d8944a Jul 06 15:28:29.751039 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:29.751016 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm"] Jul 06 15:28:29.753960 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:28:29.753930 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb51d9f_f249_4d41_af00_4d9ba9eda120.slice/crio-808fcb72d94164eefa6995a7963f90c7f011b625552b60bef03ec51dcda43a2a WatchSource:0}: Error finding container 808fcb72d94164eefa6995a7963f90c7f011b625552b60bef03ec51dcda43a2a: Status 404 returned error can't find the container with id 808fcb72d94164eefa6995a7963f90c7f011b625552b60bef03ec51dcda43a2a Jul 06 15:28:30.013998 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.013917 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"2f2bc0d208c030403ef7743ac4c7260867acea19a3db2469b5faa253357b9147"} Jul 06 15:28:30.013998 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.013983 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"2ac32e55f640f05504667c90cb51bada77a36e0b0ea729c1d8179506126b18e1"} Jul 06 15:28:30.014402 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.014017 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"8c9d1eed0a80052d86a7b18a380243b760667fc1d3df0d7b1782f288fdb268fa"} Jul 06 15:28:30.015390 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.015361 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fb47ddb8-wkfqh" event={"ID":"51d2622e-5830-42f0-9e20-7e0b4377bffc","Type":"ContainerStarted","Data":"339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536"} Jul 06 15:28:30.015507 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.015404 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fb47ddb8-wkfqh" event={"ID":"51d2622e-5830-42f0-9e20-7e0b4377bffc","Type":"ContainerStarted","Data":"04ed7f6fa3b8b64fc688e9e5ba920ee0cfec8785f9cb5e96147c422669d8944a"} Jul 06 15:28:30.016576 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.016542 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" event={"ID":"0386a46f-e06b-4224-b149-ba586c27421e","Type":"ContainerStarted","Data":"d113afc8f570c52e8fe4366cebe364f4077a02f3eb5decf033c574d390aa60be"} Jul 06 15:28:30.017521 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.017503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" event={"ID":"bcb51d9f-f249-4d41-af00-4d9ba9eda120","Type":"ContainerStarted","Data":"808fcb72d94164eefa6995a7963f90c7f011b625552b60bef03ec51dcda43a2a"} Jul 06 15:28:30.039515 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:30.039475 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54fb47ddb8-wkfqh" podStartSLOduration=2.039461245 podStartE2EDuration="2.039461245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:30.038643425 +0000 UTC m=+169.296848900" watchObservedRunningTime="2026-07-06 15:28:30.039461245 +0000 UTC m=+169.297666779" Jul 06 15:28:32.032152 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.032110 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" event={"ID":"0386a46f-e06b-4224-b149-ba586c27421e","Type":"ContainerStarted","Data":"a2816e366c449dc319794205d1b9cf338a68a9935df256f702bd1a037a1998b1"} Jul 06 15:28:32.033662 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.033636 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" event={"ID":"bcb51d9f-f249-4d41-af00-4d9ba9eda120","Type":"ContainerStarted","Data":"f9b42fb1a8e822bc314658a60ef23318fda889e3b68914939c74b15b83a4b7a9"} Jul 06 15:28:32.033833 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.033817 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:32.036810 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.036785 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"c59ee72ef1b7715f19d0f1a13ac6f40f77f200d6ef5daa28db8bebcabb67156a"} Jul 06 15:28:32.036902 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.036848 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"9ccbcb284f1f04b280feb8bebe20b09971c7b83f64d6a665c4801e32c48b647a"} Jul 06 15:28:32.036902 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.036888 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" event={"ID":"e3f23597-d2d9-4def-949e-d3a688fe90a6","Type":"ContainerStarted","Data":"5f42e0182bb51b97d70716afa2190b6bb3c8cbfa9563a25214dda8793fbd3408"} Jul 06 15:28:32.036990 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.036937 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:32.038534 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.038519 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" Jul 06 15:28:32.055551 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.055511 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" podStartSLOduration=2.124669211 podStartE2EDuration="4.055499841s" totalImagesPullingTime="1.93083063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:32.054120342 +0000 UTC m=+171.312325817" watchObservedRunningTime="2026-07-06 15:28:32.055499841 +0000 UTC m=+171.313705314" Jul 06 15:28:32.074457 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.074422 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-7cftm" podStartSLOduration=2.300421895 podStartE2EDuration="4.074409732s" totalImagesPullingTime="1.773987837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:32.073296827 +0000 UTC m=+171.331502303" watchObservedRunningTime="2026-07-06 15:28:32.074409732 +0000 UTC m=+171.332615206" Jul 06 15:28:32.103437 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.103397 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" podStartSLOduration=2.302536781 podStartE2EDuration="5.103384936s" totalImagesPullingTime="2.800848155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:28:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:28:32.100910986 +0000 UTC m=+171.359116462" watchObservedRunningTime="2026-07-06 15:28:32.103384936 +0000 UTC m=+171.361590404" Jul 06 15:28:32.794675 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:32.794634 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-566d84495b-4wvql" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerName="registry" containerID="cri-o://539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a" gracePeriod=30 Jul 06 15:28:33.029554 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.029532 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:28:33.042001 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.041974 2562 generic.go:356] "Generic (PLEG): container finished" podID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerID="539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a" exitCode=0 Jul 06 15:28:33.042327 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.042004 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-566d84495b-4wvql" event={"ID":"f98b75de-174a-4882-9ab4-d75dcb7c0e42","Type":"ContainerDied","Data":"539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a"} Jul 06 15:28:33.042327 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.042021 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-566d84495b-4wvql" Jul 06 15:28:33.042327 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.042054 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-566d84495b-4wvql" event={"ID":"f98b75de-174a-4882-9ab4-d75dcb7c0e42","Type":"ContainerDied","Data":"6a8429af3fe5b717ecd99fdab996305037e56c8e534e8b489dd4ef37e7700524"} Jul 06 15:28:33.042327 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.042094 2562 scope.go:117] "RemoveContainer" containerID="539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a" Jul 06 15:28:33.050066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.050042 2562 scope.go:117] "RemoveContainer" containerID="539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a" Jul 06 15:28:33.050330 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:28:33.050313 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a\": container with ID starting with 539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a not found: ID does not exist" containerID="539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a" Jul 06 15:28:33.050401 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.050343 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a"} err="failed to get container status \"539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a\": rpc error: code = NotFound desc = could not find container \"539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a\": container with ID starting with 539ff9fa1c2340ed87974c86cdd5c307d0aca0ad43e062d6d1204a681845425a not found: ID does not exist" Jul 06 15:28:33.079943 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.079918 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-bound-sa-token\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.079943 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.079944 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-trusted-ca\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.079983 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-image-registry-private-configuration\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080009 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-installation-pull-secrets\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080105 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080059 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nmwhs\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-kube-api-access-nmwhs\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080142 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-certificates\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080177 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f98b75de-174a-4882-9ab4-d75dcb7c0e42-ca-trust-extracted\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080319 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080230 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") pod \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\" (UID: \"f98b75de-174a-4882-9ab4-d75dcb7c0e42\") " Jul 06 15:28:33.080406 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080384 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:33.080751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.080730 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-trusted-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.082412 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.082131 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:28:33.082697 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.082671 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:28:33.083208 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.083185 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:33.083208 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.083197 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:33.083317 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.083238 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-kube-api-access-nmwhs" (OuterVolumeSpecName: "kube-api-access-nmwhs") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "kube-api-access-nmwhs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:28:33.083317 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.083264 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:28:33.092691 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.092670 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f98b75de-174a-4882-9ab4-d75dcb7c0e42-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f98b75de-174a-4882-9ab4-d75dcb7c0e42" (UID: "f98b75de-174a-4882-9ab4-d75dcb7c0e42"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:28:33.182144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182072 2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-tls\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.182144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182137 2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-bound-sa-token\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.182144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182149 2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-image-registry-private-configuration\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.182144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182160 2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f98b75de-174a-4882-9ab4-d75dcb7c0e42-installation-pull-secrets\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.182410 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182173 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmwhs\" (UniqueName: \"kubernetes.io/projected/f98b75de-174a-4882-9ab4-d75dcb7c0e42-kube-api-access-nmwhs\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.182410 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182182 2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f98b75de-174a-4882-9ab4-d75dcb7c0e42-registry-certificates\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.182410 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.182190 2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f98b75de-174a-4882-9ab4-d75dcb7c0e42-ca-trust-extracted\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:28:33.252305 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.252275 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:28:33.360510 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.360441 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-566d84495b-4wvql"] Jul 06 15:28:33.365553 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:33.365528 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-566d84495b-4wvql"] Jul 06 15:28:35.256089 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:35.256047 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" path="/var/lib/kubelet/pods/f98b75de-174a-4882-9ab4-d75dcb7c0e42/volumes" Jul 06 15:28:38.009982 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:38.009959 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qcqhg" Jul 06 15:28:38.049649 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:38.049626 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-55748799f9-sxqh9" Jul 06 15:28:38.465585 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:38.465550 2562 patch_prober.go:28] interesting pod/console-68d8fcdd78-cn44c container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" start-of-body= Jul 06 15:28:38.465768 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:38.465612 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-68d8fcdd78-cn44c" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerName="console" probeResult="failure" output="Get \"https://10.134.0.17:8443/health\": dial tcp 10.134.0.17:8443: connect: connection refused" Jul 06 15:28:39.259527 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:39.259486 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:39.259527 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:39.259536 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:39.260617 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:39.260594 2562 patch_prober.go:28] interesting pod/console-54fb47ddb8-wkfqh container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jul 06 15:28:39.260714 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:39.260643 2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-54fb47ddb8-wkfqh" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jul 06 15:28:48.470117 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:48.470064 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:48.473952 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:48.473929 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:28:49.012067 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:49.012029 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:49.012262 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:49.012108 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:28:49.263764 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:49.263695 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:49.267353 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:49.267336 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:28:49.342254 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:49.342228 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d8fcdd78-cn44c"] Jul 06 15:28:54.787424 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:54.787381 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc4d6766f-c4lhm_206cc846-ccf8-4013-9dea-edf33f1e01aa/router/0.log" Jul 06 15:28:54.813347 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:54.813322 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xj6dc_9f14e1f4-7c54-4267-8025-daec13a60188/serve-healthcheck-canary/0.log" Jul 06 15:28:59.148931 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:59.148893 2562 generic.go:356] "Generic (PLEG): container finished" podID="1169db0a-0985-41d4-ad95-56b8a98fbbcd" containerID="91c64f6e620ef21eef3ca6761e50ca851c07f4529d78a09fa2e30a3adafab88d" exitCode=0 Jul 06 15:28:59.149360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:59.148967 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" event={"ID":"1169db0a-0985-41d4-ad95-56b8a98fbbcd","Type":"ContainerDied","Data":"91c64f6e620ef21eef3ca6761e50ca851c07f4529d78a09fa2e30a3adafab88d"} Jul 06 15:28:59.149360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:28:59.149321 2562 scope.go:117] "RemoveContainer" containerID="91c64f6e620ef21eef3ca6761e50ca851c07f4529d78a09fa2e30a3adafab88d" Jul 06 15:29:00.154499 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:00.154465 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-thn45" event={"ID":"1169db0a-0985-41d4-ad95-56b8a98fbbcd","Type":"ContainerStarted","Data":"cf216e526401c3280a8b5202593aa28540b7dcc3fd057df01cec7846d4a6ff2f"} Jul 06 15:29:09.016764 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:09.016735 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:29:09.020407 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:09.020389 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5466568bf7-6jhxm" Jul 06 15:29:15.128766 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.128726 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-68d8fcdd78-cn44c" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerName="console" containerID="cri-o://44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e" gracePeriod=15 Jul 06 15:29:15.371164 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.371142 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:29:15.428187 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428122 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-oauth-serving-cert\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428187 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428179 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-serving-cert\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428199 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9gp5\" (UniqueName: \"kubernetes.io/projected/a6a1e386-e14f-4d72-b64a-83c24c255a31-kube-api-access-b9gp5\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428219 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-service-ca\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428239 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-oauth-config\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428258 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-config\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428273 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-trusted-ca-bundle\") pod \"a6a1e386-e14f-4d72-b64a-83c24c255a31\" (UID: \"a6a1e386-e14f-4d72-b64a-83c24c255a31\") " Jul 06 15:29:15.428641 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428523 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:15.428744 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428707 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:15.428792 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428717 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-config" (OuterVolumeSpecName: "console-config") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:15.428792 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.428772 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:29:15.430481 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.430457 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:15.430760 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.430739 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:29:15.430831 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.430755 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6a1e386-e14f-4d72-b64a-83c24c255a31-kube-api-access-b9gp5" (OuterVolumeSpecName: "kube-api-access-b9gp5") pod "a6a1e386-e14f-4d72-b64a-83c24c255a31" (UID: "a6a1e386-e14f-4d72-b64a-83c24c255a31"). InnerVolumeSpecName "kube-api-access-b9gp5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:29:15.529833 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529806 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-serving-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:15.529833 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529828 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9gp5\" (UniqueName: \"kubernetes.io/projected/a6a1e386-e14f-4d72-b64a-83c24c255a31-kube-api-access-b9gp5\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:15.529988 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529840 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:15.529988 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529849 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-oauth-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:15.529988 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529858 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-console-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:15.529988 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529867 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-trusted-ca-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:15.529988 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:15.529875 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6a1e386-e14f-4d72-b64a-83c24c255a31-oauth-serving-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:29:16.214436 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.214405 2562 generic.go:356] "Generic (PLEG): container finished" podID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerID="44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e" exitCode=0 Jul 06 15:29:16.214818 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.214448 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d8fcdd78-cn44c" event={"ID":"a6a1e386-e14f-4d72-b64a-83c24c255a31","Type":"ContainerDied","Data":"44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e"} Jul 06 15:29:16.214818 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.214459 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-68d8fcdd78-cn44c" Jul 06 15:29:16.214818 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.214486 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-68d8fcdd78-cn44c" event={"ID":"a6a1e386-e14f-4d72-b64a-83c24c255a31","Type":"ContainerDied","Data":"e590c09fd02bd6067346d6c0e736d29758423c2c0cbd4b13a6a5f327118317d3"} Jul 06 15:29:16.214818 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.214504 2562 scope.go:117] "RemoveContainer" containerID="44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e" Jul 06 15:29:16.223456 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.223441 2562 scope.go:117] "RemoveContainer" containerID="44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e" Jul 06 15:29:16.223722 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:29:16.223705 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e\": container with ID starting with 44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e not found: ID does not exist" containerID="44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e" Jul 06 15:29:16.223785 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.223727 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e"} err="failed to get container status \"44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e\": rpc error: code = NotFound desc = could not find container \"44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e\": container with ID starting with 44a3980728197ae13f2065f7aec7240a1e8d16a6ecef87c360599c132c21334e not found: ID does not exist" Jul 06 15:29:16.237604 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.237579 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-68d8fcdd78-cn44c"] Jul 06 15:29:16.246623 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:16.246599 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-68d8fcdd78-cn44c"] Jul 06 15:29:17.255940 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:17.255908 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" path="/var/lib/kubelet/pods/a6a1e386-e14f-4d72-b64a-83c24c255a31/volumes" Jul 06 15:29:52.021192 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:52.021146 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:29:52.023413 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:52.023392 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49eb4904-bf89-4ed9-9907-cc03d24a28ff-metrics-certs\") pod \"network-metrics-daemon-l5b48\" (UID: \"49eb4904-bf89-4ed9-9907-cc03d24a28ff\") " pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:29:52.155885 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:52.155856 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cvwwb\"" Jul 06 15:29:52.164074 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:52.164053 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l5b48" Jul 06 15:29:52.299779 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:52.299618 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l5b48"] Jul 06 15:29:52.302505 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:29:52.302481 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49eb4904_bf89_4ed9_9907_cc03d24a28ff.slice/crio-e4a71730bbe3d42dc4a2d2f3ae6dccac543b45ea4bf6b622d1018cffe3366f9e WatchSource:0}: Error finding container e4a71730bbe3d42dc4a2d2f3ae6dccac543b45ea4bf6b622d1018cffe3366f9e: Status 404 returned error can't find the container with id e4a71730bbe3d42dc4a2d2f3ae6dccac543b45ea4bf6b622d1018cffe3366f9e Jul 06 15:29:52.343331 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:52.343295 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5b48" event={"ID":"49eb4904-bf89-4ed9-9907-cc03d24a28ff","Type":"ContainerStarted","Data":"e4a71730bbe3d42dc4a2d2f3ae6dccac543b45ea4bf6b622d1018cffe3366f9e"} Jul 06 15:29:54.354156 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:54.354121 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5b48" event={"ID":"49eb4904-bf89-4ed9-9907-cc03d24a28ff","Type":"ContainerStarted","Data":"7fc897685396625d97b78865620f5561a681945a1a6dac0568f7ba887113ec13"} Jul 06 15:29:54.354557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:54.354174 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l5b48" event={"ID":"49eb4904-bf89-4ed9-9907-cc03d24a28ff","Type":"ContainerStarted","Data":"09074b8d762d6e24c8d1cf0ceab6aa3c7d750d15de13fa63dd065378ad305af3"} Jul 06 15:29:54.375548 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:29:54.375502 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l5b48" podStartSLOduration=251.240244222 podStartE2EDuration="4m12.375487769s" totalImagesPullingTime="1.135243547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:29:54.37427858 +0000 UTC m=+253.632484053" watchObservedRunningTime="2026-07-06 15:29:54.375487769 +0000 UTC m=+253.633693242" Jul 06 15:30:04.203324 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:04.203240 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fb47ddb8-wkfqh"] Jul 06 15:30:29.223832 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.223764 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54fb47ddb8-wkfqh" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerName="console" containerID="cri-o://339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536" gracePeriod=15 Jul 06 15:30:29.264380 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.264355 2562 patch_prober.go:28] interesting pod/console-54fb47ddb8-wkfqh container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" start-of-body= Jul 06 15:30:29.264492 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.264415 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-54fb47ddb8-wkfqh" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerName="console" probeResult="failure" output="Get \"https://10.134.0.21:8443/health\": dial tcp 10.134.0.21:8443: connect: connection refused" Jul 06 15:30:29.469266 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.469242 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:30:29.483754 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.483689 2562 generic.go:356] "Generic (PLEG): container finished" podID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerID="339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536" exitCode=0 Jul 06 15:30:29.483754 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.483736 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54fb47ddb8-wkfqh" Jul 06 15:30:29.483929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.483784 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fb47ddb8-wkfqh" event={"ID":"51d2622e-5830-42f0-9e20-7e0b4377bffc","Type":"ContainerDied","Data":"339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536"} Jul 06 15:30:29.483929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.483847 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54fb47ddb8-wkfqh" event={"ID":"51d2622e-5830-42f0-9e20-7e0b4377bffc","Type":"ContainerDied","Data":"04ed7f6fa3b8b64fc688e9e5ba920ee0cfec8785f9cb5e96147c422669d8944a"} Jul 06 15:30:29.483929 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.483876 2562 scope.go:117] "RemoveContainer" containerID="339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536" Jul 06 15:30:29.491527 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.491499 2562 scope.go:117] "RemoveContainer" containerID="339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536" Jul 06 15:30:29.491792 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:30:29.491773 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536\": container with ID starting with 339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536 not found: ID does not exist" containerID="339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536" Jul 06 15:30:29.491862 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.491803 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536"} err="failed to get container status \"339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536\": rpc error: code = NotFound desc = could not find container \"339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536\": container with ID starting with 339184951cd215fc94247037aa204d8a76515a6538e082cb4343e35bbad72536 not found: ID does not exist" Jul 06 15:30:29.503424 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503396 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwl7n\" (UniqueName: \"kubernetes.io/projected/51d2622e-5830-42f0-9e20-7e0b4377bffc-kube-api-access-mwl7n\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.503527 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503445 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-serving-cert\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.503527 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503487 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-trusted-ca-bundle\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.503642 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503531 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-oauth-serving-cert\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.503642 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503566 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-config\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.503642 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503598 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-service-ca\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.503841 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.503640 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-oauth-config\") pod \"51d2622e-5830-42f0-9e20-7e0b4377bffc\" (UID: \"51d2622e-5830-42f0-9e20-7e0b4377bffc\") " Jul 06 15:30:29.504023 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.504000 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:30:29.504144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.504023 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:30:29.504144 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.504033 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-config" (OuterVolumeSpecName: "console-config") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:30:29.504239 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.504156 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-service-ca" (OuterVolumeSpecName: "service-ca") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:30:29.505628 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.505602 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51d2622e-5830-42f0-9e20-7e0b4377bffc-kube-api-access-mwl7n" (OuterVolumeSpecName: "kube-api-access-mwl7n") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "kube-api-access-mwl7n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:30:29.505718 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.505636 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:30:29.506108 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.506058 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "51d2622e-5830-42f0-9e20-7e0b4377bffc" (UID: "51d2622e-5830-42f0-9e20-7e0b4377bffc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:30:29.604720 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604692 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.604720 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604717 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.604912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604728 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-oauth-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.604912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604741 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwl7n\" (UniqueName: \"kubernetes.io/projected/51d2622e-5830-42f0-9e20-7e0b4377bffc-kube-api-access-mwl7n\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.604912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604753 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/51d2622e-5830-42f0-9e20-7e0b4377bffc-console-serving-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.604912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604764 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-trusted-ca-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.604912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.604774 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/51d2622e-5830-42f0-9e20-7e0b4377bffc-oauth-serving-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:30:29.807013 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.806985 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54fb47ddb8-wkfqh"] Jul 06 15:30:29.812160 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:29.812140 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54fb47ddb8-wkfqh"] Jul 06 15:30:31.255919 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:31.255887 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" path="/var/lib/kubelet/pods/51d2622e-5830-42f0-9e20-7e0b4377bffc/volumes" Jul 06 15:30:41.103556 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:30:41.103522 2562 kubelet.go:1648] "Image garbage collection succeeded" Jul 06 15:31:02.826756 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.826716 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b68549bfc-hvwjl"] Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827062 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerName="console" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827098 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerName="console" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827114 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerName="registry" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827119 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerName="registry" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827130 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerName="console" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827136 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerName="console" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827184 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6a1e386-e14f-4d72-b64a-83c24c255a31" containerName="console" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827191 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51d2622e-5830-42f0-9e20-7e0b4377bffc" containerName="console" Jul 06 15:31:02.829226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.827198 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f98b75de-174a-4882-9ab4-d75dcb7c0e42" containerName="registry" Jul 06 15:31:02.830037 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.830021 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.834217 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.834193 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 06 15:31:02.834344 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.834193 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 06 15:31:02.835138 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.835115 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 06 15:31:02.835138 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.835124 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 06 15:31:02.835376 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.835359 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 06 15:31:02.835533 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.835512 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 06 15:31:02.835640 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.835431 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 06 15:31:02.835699 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.835400 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dr2fb\"" Jul 06 15:31:02.839571 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.839535 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 06 15:31:02.841556 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.841536 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b68549bfc-hvwjl"] Jul 06 15:31:02.968230 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968199 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-config\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.968414 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968245 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-oauth-serving-cert\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.968414 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968264 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-serving-cert\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.968414 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968289 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqpjq\" (UniqueName: \"kubernetes.io/projected/01f381be-2cbb-4d7e-85f1-c7feebffd16a-kube-api-access-dqpjq\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.968414 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968361 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-trusted-ca-bundle\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.968414 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968410 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-oauth-config\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:02.968605 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:02.968451 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-service-ca\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069685 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069652 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-oauth-serving-cert\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069685 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069684 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-serving-cert\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069936 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069705 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqpjq\" (UniqueName: \"kubernetes.io/projected/01f381be-2cbb-4d7e-85f1-c7feebffd16a-kube-api-access-dqpjq\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069936 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069732 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-trusted-ca-bundle\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069936 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069758 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-oauth-config\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069936 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069779 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-service-ca\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.069936 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.069806 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-config\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.070512 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.070484 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-oauth-serving-cert\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.070620 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.070535 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-config\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.070680 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.070627 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-service-ca\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.070680 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.070643 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-trusted-ca-bundle\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.072316 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.072296 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-serving-cert\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.072407 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.072351 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-oauth-config\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.079817 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.079765 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqpjq\" (UniqueName: \"kubernetes.io/projected/01f381be-2cbb-4d7e-85f1-c7feebffd16a-kube-api-access-dqpjq\") pod \"console-b68549bfc-hvwjl\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.139869 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.139829 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:03.269503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.269475 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b68549bfc-hvwjl"] Jul 06 15:31:03.272450 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:31:03.272426 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01f381be_2cbb_4d7e_85f1_c7feebffd16a.slice/crio-182d0cbfc171907782ae3b42b9eaf9f4ad913964ed6764c4fe944d674f3816f2 WatchSource:0}: Error finding container 182d0cbfc171907782ae3b42b9eaf9f4ad913964ed6764c4fe944d674f3816f2: Status 404 returned error can't find the container with id 182d0cbfc171907782ae3b42b9eaf9f4ad913964ed6764c4fe944d674f3816f2 Jul 06 15:31:03.610404 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.610366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68549bfc-hvwjl" event={"ID":"01f381be-2cbb-4d7e-85f1-c7feebffd16a","Type":"ContainerStarted","Data":"db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f"} Jul 06 15:31:03.610601 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.610415 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68549bfc-hvwjl" event={"ID":"01f381be-2cbb-4d7e-85f1-c7feebffd16a","Type":"ContainerStarted","Data":"182d0cbfc171907782ae3b42b9eaf9f4ad913964ed6764c4fe944d674f3816f2"} Jul 06 15:31:03.630475 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:03.630426 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b68549bfc-hvwjl" podStartSLOduration=1.63040668 podStartE2EDuration="1.63040668s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:31:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:31:03.629783867 +0000 UTC m=+322.887989353" watchObservedRunningTime="2026-07-06 15:31:03.63040668 +0000 UTC m=+322.888612154" Jul 06 15:31:13.140384 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:13.140350 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:13.140869 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:13.140415 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:13.145101 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:13.145059 2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:31:13.650780 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:31:13.650744 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:32:13.336368 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.336335 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5"] Jul 06 15:32:13.339570 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.339553 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.342436 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.342414 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:32:13.343545 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.343527 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:32:13.343637 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.343561 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b5r6f\"" Jul 06 15:32:13.356133 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.356110 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5"] Jul 06 15:32:13.503219 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.503193 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl6pp\" (UniqueName: \"kubernetes.io/projected/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-kube-api-access-fl6pp\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.503356 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.503239 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.503356 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.503319 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.604382 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.604316 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.604382 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.604370 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.604536 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.604509 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl6pp\" (UniqueName: \"kubernetes.io/projected/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-kube-api-access-fl6pp\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.604729 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.604711 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.604729 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.604721 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.616515 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.616487 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl6pp\" (UniqueName: \"kubernetes.io/projected/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-kube-api-access-fl6pp\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.648844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.648828 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:13.785508 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.785476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5"] Jul 06 15:32:13.788826 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:32:13.788802 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a995133_c0ab_44a0_aaf1_daf2e4589fd9.slice/crio-8bd681cc42c124ff2f0d9e22a3d7b1f10ebbdb3caed3df5db01935e06cd397d4 WatchSource:0}: Error finding container 8bd681cc42c124ff2f0d9e22a3d7b1f10ebbdb3caed3df5db01935e06cd397d4: Status 404 returned error can't find the container with id 8bd681cc42c124ff2f0d9e22a3d7b1f10ebbdb3caed3df5db01935e06cd397d4 Jul 06 15:32:13.790806 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.790786 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:32:13.864050 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:13.863987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" event={"ID":"9a995133-c0ab-44a0-aaf1-daf2e4589fd9","Type":"ContainerStarted","Data":"8bd681cc42c124ff2f0d9e22a3d7b1f10ebbdb3caed3df5db01935e06cd397d4"} Jul 06 15:32:19.892019 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:19.891930 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerID="66d1f604124fab4033b4a5749a509391198362aa7c930eb0fd717d98fb540f60" exitCode=0 Jul 06 15:32:19.892019 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:19.891974 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" event={"ID":"9a995133-c0ab-44a0-aaf1-daf2e4589fd9","Type":"ContainerDied","Data":"66d1f604124fab4033b4a5749a509391198362aa7c930eb0fd717d98fb540f60"} Jul 06 15:32:22.908163 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:22.908129 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerID="398794de5a927e96e23f7e0cea7432b90880e6d9e8b73cd52888375350223024" exitCode=0 Jul 06 15:32:22.908536 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:22.908168 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" event={"ID":"9a995133-c0ab-44a0-aaf1-daf2e4589fd9","Type":"ContainerDied","Data":"398794de5a927e96e23f7e0cea7432b90880e6d9e8b73cd52888375350223024"} Jul 06 15:32:31.943962 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:31.943924 2562 generic.go:356] "Generic (PLEG): container finished" podID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerID="099ef1cbbfc38e94ad49f096995f5e5ec6a352797e7b6b682c5442770f521a3b" exitCode=0 Jul 06 15:32:31.944350 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:31.944008 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" event={"ID":"9a995133-c0ab-44a0-aaf1-daf2e4589fd9","Type":"ContainerDied","Data":"099ef1cbbfc38e94ad49f096995f5e5ec6a352797e7b6b682c5442770f521a3b"} Jul 06 15:32:33.079782 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.079763 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:33.163745 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.163719 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-bundle\") pod \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " Jul 06 15:32:33.163745 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.163751 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fl6pp\" (UniqueName: \"kubernetes.io/projected/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-kube-api-access-fl6pp\") pod \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " Jul 06 15:32:33.163933 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.163805 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-util\") pod \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\" (UID: \"9a995133-c0ab-44a0-aaf1-daf2e4589fd9\") " Jul 06 15:32:33.164420 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.164387 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-bundle" (OuterVolumeSpecName: "bundle") pod "9a995133-c0ab-44a0-aaf1-daf2e4589fd9" (UID: "9a995133-c0ab-44a0-aaf1-daf2e4589fd9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:32:33.165878 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.165856 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-kube-api-access-fl6pp" (OuterVolumeSpecName: "kube-api-access-fl6pp") pod "9a995133-c0ab-44a0-aaf1-daf2e4589fd9" (UID: "9a995133-c0ab-44a0-aaf1-daf2e4589fd9"). InnerVolumeSpecName "kube-api-access-fl6pp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:32:33.167687 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.167668 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-util" (OuterVolumeSpecName: "util") pod "9a995133-c0ab-44a0-aaf1-daf2e4589fd9" (UID: "9a995133-c0ab-44a0-aaf1-daf2e4589fd9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:32:33.264182 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.264160 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:32:33.264182 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.264181 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fl6pp\" (UniqueName: \"kubernetes.io/projected/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-kube-api-access-fl6pp\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:32:33.264316 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.264190 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9a995133-c0ab-44a0-aaf1-daf2e4589fd9-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:32:33.952871 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.952843 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" Jul 06 15:32:33.953013 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.952838 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589zkzz5" event={"ID":"9a995133-c0ab-44a0-aaf1-daf2e4589fd9","Type":"ContainerDied","Data":"8bd681cc42c124ff2f0d9e22a3d7b1f10ebbdb3caed3df5db01935e06cd397d4"} Jul 06 15:32:33.953013 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:33.952962 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8bd681cc42c124ff2f0d9e22a3d7b1f10ebbdb3caed3df5db01935e06cd397d4" Jul 06 15:32:41.707926 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.707892 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8"] Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708192 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="extract" Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708204 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="extract" Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708214 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="util" Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708220 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="util" Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708226 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="pull" Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708231 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="pull" Jul 06 15:32:41.708381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.708275 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a995133-c0ab-44a0-aaf1-daf2e4589fd9" containerName="extract" Jul 06 15:32:41.712066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.712048 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:41.717066 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.717042 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 06 15:32:41.717219 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.717165 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 06 15:32:41.717469 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.717450 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 06 15:32:41.717520 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.717459 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-gmk2m\"" Jul 06 15:32:41.728015 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.727996 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8"] Jul 06 15:32:41.836873 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.836845 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwcxv\" (UniqueName: \"kubernetes.io/projected/36bd5969-1c0f-42a4-a550-052f5fdc7eb6-kube-api-access-bwcxv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8\" (UID: \"36bd5969-1c0f-42a4-a550-052f5fdc7eb6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:41.836873 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.836878 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/36bd5969-1c0f-42a4-a550-052f5fdc7eb6-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8\" (UID: \"36bd5969-1c0f-42a4-a550-052f5fdc7eb6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:41.938152 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.938108 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwcxv\" (UniqueName: \"kubernetes.io/projected/36bd5969-1c0f-42a4-a550-052f5fdc7eb6-kube-api-access-bwcxv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8\" (UID: \"36bd5969-1c0f-42a4-a550-052f5fdc7eb6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:41.938152 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.938155 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/36bd5969-1c0f-42a4-a550-052f5fdc7eb6-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8\" (UID: \"36bd5969-1c0f-42a4-a550-052f5fdc7eb6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:41.940397 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.940366 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/36bd5969-1c0f-42a4-a550-052f5fdc7eb6-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8\" (UID: \"36bd5969-1c0f-42a4-a550-052f5fdc7eb6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:41.979184 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:41.979118 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwcxv\" (UniqueName: \"kubernetes.io/projected/36bd5969-1c0f-42a4-a550-052f5fdc7eb6-kube-api-access-bwcxv\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8\" (UID: \"36bd5969-1c0f-42a4-a550-052f5fdc7eb6\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:42.021842 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:42.021814 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:42.163640 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:42.163617 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8"] Jul 06 15:32:42.165641 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:32:42.165615 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36bd5969_1c0f_42a4_a550_052f5fdc7eb6.slice/crio-c23f2a8293cde3005be3df1f82e343f1ab09a04c760fdcad7ef709c5064ae0c1 WatchSource:0}: Error finding container c23f2a8293cde3005be3df1f82e343f1ab09a04c760fdcad7ef709c5064ae0c1: Status 404 returned error can't find the container with id c23f2a8293cde3005be3df1f82e343f1ab09a04c760fdcad7ef709c5064ae0c1 Jul 06 15:32:42.996445 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:42.996407 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" event={"ID":"36bd5969-1c0f-42a4-a550-052f5fdc7eb6","Type":"ContainerStarted","Data":"c23f2a8293cde3005be3df1f82e343f1ab09a04c760fdcad7ef709c5064ae0c1"} Jul 06 15:32:45.007335 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:45.007239 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" event={"ID":"36bd5969-1c0f-42a4-a550-052f5fdc7eb6","Type":"ContainerStarted","Data":"9c526f35d43923d5aebdaef1821229e70fde01c4426205b6f55e7e3c574f722a"} Jul 06 15:32:45.007335 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:45.007328 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:32:45.044121 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:45.044041 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" podStartSLOduration=1.5697565249999998 podStartE2EDuration="4.044020579s" totalImagesPullingTime="2.474264054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:32:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:32:45.042318513 +0000 UTC m=+424.300523988" watchObservedRunningTime="2026-07-06 15:32:45.044020579 +0000 UTC m=+424.302226054" Jul 06 15:32:46.798522 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.798486 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2cnxl"] Jul 06 15:32:46.800584 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.800567 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:46.806966 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.806904 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-fqwmc\"" Jul 06 15:32:46.806966 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.806904 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-admission-webhooks-certs\"" Jul 06 15:32:46.807193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.807177 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 06 15:32:46.822504 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.822476 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2cnxl"] Jul 06 15:32:46.881155 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.880951 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/612b3a68-bf6e-44b6-9c88-92b8cd809bba-certificates\") pod \"keda-admission-5fbd5c4644-2cnxl\" (UID: \"612b3a68-bf6e-44b6-9c88-92b8cd809bba\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:46.881155 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.881036 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcgwd\" (UniqueName: \"kubernetes.io/projected/612b3a68-bf6e-44b6-9c88-92b8cd809bba-kube-api-access-rcgwd\") pod \"keda-admission-5fbd5c4644-2cnxl\" (UID: \"612b3a68-bf6e-44b6-9c88-92b8cd809bba\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:46.981926 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.981895 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcgwd\" (UniqueName: \"kubernetes.io/projected/612b3a68-bf6e-44b6-9c88-92b8cd809bba-kube-api-access-rcgwd\") pod \"keda-admission-5fbd5c4644-2cnxl\" (UID: \"612b3a68-bf6e-44b6-9c88-92b8cd809bba\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:46.982128 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.981954 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/612b3a68-bf6e-44b6-9c88-92b8cd809bba-certificates\") pod \"keda-admission-5fbd5c4644-2cnxl\" (UID: \"612b3a68-bf6e-44b6-9c88-92b8cd809bba\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:46.984498 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.984475 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/612b3a68-bf6e-44b6-9c88-92b8cd809bba-certificates\") pod \"keda-admission-5fbd5c4644-2cnxl\" (UID: \"612b3a68-bf6e-44b6-9c88-92b8cd809bba\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:46.998837 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:46.998809 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcgwd\" (UniqueName: \"kubernetes.io/projected/612b3a68-bf6e-44b6-9c88-92b8cd809bba-kube-api-access-rcgwd\") pod \"keda-admission-5fbd5c4644-2cnxl\" (UID: \"612b3a68-bf6e-44b6-9c88-92b8cd809bba\") " pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:47.110864 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:47.110778 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:47.266535 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:47.266513 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-admission-5fbd5c4644-2cnxl"] Jul 06 15:32:47.268169 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:32:47.268140 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612b3a68_bf6e_44b6_9c88_92b8cd809bba.slice/crio-26b7697ff233fcad426f518c4dcfabc937dee516e71c473724d7fd0df90400ad WatchSource:0}: Error finding container 26b7697ff233fcad426f518c4dcfabc937dee516e71c473724d7fd0df90400ad: Status 404 returned error can't find the container with id 26b7697ff233fcad426f518c4dcfabc937dee516e71c473724d7fd0df90400ad Jul 06 15:32:48.021541 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:48.021503 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" event={"ID":"612b3a68-bf6e-44b6-9c88-92b8cd809bba","Type":"ContainerStarted","Data":"26b7697ff233fcad426f518c4dcfabc937dee516e71c473724d7fd0df90400ad"} Jul 06 15:32:49.027790 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:49.027755 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" event={"ID":"612b3a68-bf6e-44b6-9c88-92b8cd809bba","Type":"ContainerStarted","Data":"513a6c0d0e99e2fe8cb863dee628864fee3c28f2fde741ab0d5654b3d76af11e"} Jul 06 15:32:49.028287 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:49.027844 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:32:49.063416 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:32:49.063320 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" podStartSLOduration=1.540052526 podStartE2EDuration="3.063307726s" totalImagesPullingTime="1.5232552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:32:49.062507137 +0000 UTC m=+428.320712611" watchObservedRunningTime="2026-07-06 15:32:49.063307726 +0000 UTC m=+428.321513200" Jul 06 15:33:06.015511 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:33:06.015441 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-pzqh8" Jul 06 15:33:10.034958 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:33:10.034927 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-admission-5fbd5c4644-2cnxl" Jul 06 15:34:04.547371 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.547331 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/llmisvc-controller-manager-74dff9949f-2g4pw"] Jul 06 15:34:04.550709 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.550693 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.558854 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.558830 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-controller-manager-dockercfg-6ftq8\"" Jul 06 15:34:04.558854 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.558850 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"llmisvc-webhook-server-cert\"" Jul 06 15:34:04.559051 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.558855 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 06 15:34:04.560618 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.560602 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 06 15:34:04.578199 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.578175 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-74dff9949f-2g4pw"] Jul 06 15:34:04.660731 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.660697 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmk5s\" (UniqueName: \"kubernetes.io/projected/6a1468a4-d213-4e62-ab55-3410a7827c35-kube-api-access-dmk5s\") pod \"llmisvc-controller-manager-74dff9949f-2g4pw\" (UID: \"6a1468a4-d213-4e62-ab55-3410a7827c35\") " pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.660731 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.660738 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a1468a4-d213-4e62-ab55-3410a7827c35-cert\") pod \"llmisvc-controller-manager-74dff9949f-2g4pw\" (UID: \"6a1468a4-d213-4e62-ab55-3410a7827c35\") " pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.761423 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.761387 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmk5s\" (UniqueName: \"kubernetes.io/projected/6a1468a4-d213-4e62-ab55-3410a7827c35-kube-api-access-dmk5s\") pod \"llmisvc-controller-manager-74dff9949f-2g4pw\" (UID: \"6a1468a4-d213-4e62-ab55-3410a7827c35\") " pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.761423 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.761429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a1468a4-d213-4e62-ab55-3410a7827c35-cert\") pod \"llmisvc-controller-manager-74dff9949f-2g4pw\" (UID: \"6a1468a4-d213-4e62-ab55-3410a7827c35\") " pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.763785 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.763753 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6a1468a4-d213-4e62-ab55-3410a7827c35-cert\") pod \"llmisvc-controller-manager-74dff9949f-2g4pw\" (UID: \"6a1468a4-d213-4e62-ab55-3410a7827c35\") " pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.774531 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.774506 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmk5s\" (UniqueName: \"kubernetes.io/projected/6a1468a4-d213-4e62-ab55-3410a7827c35-kube-api-access-dmk5s\") pod \"llmisvc-controller-manager-74dff9949f-2g4pw\" (UID: \"6a1468a4-d213-4e62-ab55-3410a7827c35\") " pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:04.860483 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:04.860403 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:05.009584 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:05.009556 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/llmisvc-controller-manager-74dff9949f-2g4pw"] Jul 06 15:34:05.011897 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:34:05.011872 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6a1468a4_d213_4e62_ab55_3410a7827c35.slice/crio-11b5a4e9221f3b8e6201f4ff5534ce633acd86c7cf41e30d367c3711014df295 WatchSource:0}: Error finding container 11b5a4e9221f3b8e6201f4ff5534ce633acd86c7cf41e30d367c3711014df295: Status 404 returned error can't find the container with id 11b5a4e9221f3b8e6201f4ff5534ce633acd86c7cf41e30d367c3711014df295 Jul 06 15:34:05.334797 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:05.334764 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" event={"ID":"6a1468a4-d213-4e62-ab55-3410a7827c35","Type":"ContainerStarted","Data":"11b5a4e9221f3b8e6201f4ff5534ce633acd86c7cf41e30d367c3711014df295"} Jul 06 15:34:09.352560 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:09.352526 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" event={"ID":"6a1468a4-d213-4e62-ab55-3410a7827c35","Type":"ContainerStarted","Data":"46f55dceca2ca4d4e0ea7d66c9f4eaade89393b7495c4ce8b29d1c0df88192e5"} Jul 06 15:34:09.352940 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:09.352643 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:09.375005 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:09.374962 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" podStartSLOduration=1.699405343 podStartE2EDuration="5.374948036s" totalImagesPullingTime="3.675542693s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:34:09.374264768 +0000 UTC m=+508.632470243" watchObservedRunningTime="2026-07-06 15:34:09.374948036 +0000 UTC m=+508.633153509" Jul 06 15:34:40.359113 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:40.359022 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/llmisvc-controller-manager-74dff9949f-2g4pw" Jul 06 15:34:42.094531 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.094493 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4"] Jul 06 15:34:42.102156 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.102135 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.109093 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.109057 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:34:42.109293 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.109277 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b5r6f\"" Jul 06 15:34:42.110237 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.110219 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:34:42.123522 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.123475 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4"] Jul 06 15:34:42.156422 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.156387 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pzfd\" (UniqueName: \"kubernetes.io/projected/86743a12-7783-4480-9d76-d27186b2f5d4-kube-api-access-7pzfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.156533 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.156447 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.156533 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.156485 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.257124 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.257098 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.257256 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.257137 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.257256 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.257164 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pzfd\" (UniqueName: \"kubernetes.io/projected/86743a12-7783-4480-9d76-d27186b2f5d4-kube-api-access-7pzfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.257456 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.257438 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.257527 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.257505 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.270523 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.270494 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pzfd\" (UniqueName: \"kubernetes.io/projected/86743a12-7783-4480-9d76-d27186b2f5d4-kube-api-access-7pzfd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.411170 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.411104 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:42.547646 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:42.547623 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4"] Jul 06 15:34:42.549251 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:34:42.549222 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86743a12_7783_4480_9d76_d27186b2f5d4.slice/crio-f12e186346ddedc336fec3586d519585de0f5b5988943901d6f846404fa488f6 WatchSource:0}: Error finding container f12e186346ddedc336fec3586d519585de0f5b5988943901d6f846404fa488f6: Status 404 returned error can't find the container with id f12e186346ddedc336fec3586d519585de0f5b5988943901d6f846404fa488f6 Jul 06 15:34:43.494464 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:43.494427 2562 generic.go:356] "Generic (PLEG): container finished" podID="86743a12-7783-4480-9d76-d27186b2f5d4" containerID="900b2f815e3a0ba3af50877f5e2390c2fe35f4ab46ff1e28b2a8e2b6adf52002" exitCode=0 Jul 06 15:34:43.494914 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:43.494488 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" event={"ID":"86743a12-7783-4480-9d76-d27186b2f5d4","Type":"ContainerDied","Data":"900b2f815e3a0ba3af50877f5e2390c2fe35f4ab46ff1e28b2a8e2b6adf52002"} Jul 06 15:34:43.494914 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:43.494538 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" event={"ID":"86743a12-7783-4480-9d76-d27186b2f5d4","Type":"ContainerStarted","Data":"f12e186346ddedc336fec3586d519585de0f5b5988943901d6f846404fa488f6"} Jul 06 15:34:46.510262 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:46.510224 2562 generic.go:356] "Generic (PLEG): container finished" podID="86743a12-7783-4480-9d76-d27186b2f5d4" containerID="feb68f90c64576dab5614f990528d691a837937e5797d10b0b406ef5a148a2e8" exitCode=0 Jul 06 15:34:46.510653 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:46.510288 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" event={"ID":"86743a12-7783-4480-9d76-d27186b2f5d4","Type":"ContainerDied","Data":"feb68f90c64576dab5614f990528d691a837937e5797d10b0b406ef5a148a2e8"} Jul 06 15:34:47.516773 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:47.516739 2562 generic.go:356] "Generic (PLEG): container finished" podID="86743a12-7783-4480-9d76-d27186b2f5d4" containerID="da254ad0620028b714022602f47f81de78d19f35db1a94a37ea285b294970cf8" exitCode=0 Jul 06 15:34:47.516773 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:47.516777 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" event={"ID":"86743a12-7783-4480-9d76-d27186b2f5d4","Type":"ContainerDied","Data":"da254ad0620028b714022602f47f81de78d19f35db1a94a37ea285b294970cf8"} Jul 06 15:34:48.644359 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.644335 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:48.704806 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.704774 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pzfd\" (UniqueName: \"kubernetes.io/projected/86743a12-7783-4480-9d76-d27186b2f5d4-kube-api-access-7pzfd\") pod \"86743a12-7783-4480-9d76-d27186b2f5d4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " Jul 06 15:34:48.704951 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.704815 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-util\") pod \"86743a12-7783-4480-9d76-d27186b2f5d4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " Jul 06 15:34:48.704951 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.704931 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-bundle\") pod \"86743a12-7783-4480-9d76-d27186b2f5d4\" (UID: \"86743a12-7783-4480-9d76-d27186b2f5d4\") " Jul 06 15:34:48.705662 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.705629 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-bundle" (OuterVolumeSpecName: "bundle") pod "86743a12-7783-4480-9d76-d27186b2f5d4" (UID: "86743a12-7783-4480-9d76-d27186b2f5d4"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:34:48.706840 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.706818 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86743a12-7783-4480-9d76-d27186b2f5d4-kube-api-access-7pzfd" (OuterVolumeSpecName: "kube-api-access-7pzfd") pod "86743a12-7783-4480-9d76-d27186b2f5d4" (UID: "86743a12-7783-4480-9d76-d27186b2f5d4"). InnerVolumeSpecName "kube-api-access-7pzfd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:34:48.709557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.709528 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-util" (OuterVolumeSpecName: "util") pod "86743a12-7783-4480-9d76-d27186b2f5d4" (UID: "86743a12-7783-4480-9d76-d27186b2f5d4"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:34:48.805777 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.805707 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:34:48.805777 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.805732 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pzfd\" (UniqueName: \"kubernetes.io/projected/86743a12-7783-4480-9d76-d27186b2f5d4-kube-api-access-7pzfd\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:34:48.805777 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:48.805743 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86743a12-7783-4480-9d76-d27186b2f5d4-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:34:49.527653 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:49.527621 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" event={"ID":"86743a12-7783-4480-9d76-d27186b2f5d4","Type":"ContainerDied","Data":"f12e186346ddedc336fec3586d519585de0f5b5988943901d6f846404fa488f6"} Jul 06 15:34:49.527653 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:49.527646 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540xxvg4" Jul 06 15:34:49.527840 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:34:49.527670 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f12e186346ddedc336fec3586d519585de0f5b5988943901d6f846404fa488f6" Jul 06 15:35:04.544161 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544129 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm"] Jul 06 15:35:04.544503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544455 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="extract" Jul 06 15:35:04.544503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544466 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="extract" Jul 06 15:35:04.544503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544476 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="pull" Jul 06 15:35:04.544503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544481 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="pull" Jul 06 15:35:04.544503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544490 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="util" Jul 06 15:35:04.544503 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544495 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="util" Jul 06 15:35:04.544721 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.544556 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="86743a12-7783-4480-9d76-d27186b2f5d4" containerName="extract" Jul 06 15:35:04.548620 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.548605 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.558895 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.558876 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:35:04.559091 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.559066 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b5r6f\"" Jul 06 15:35:04.576049 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.576019 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:35:04.587851 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.587828 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm"] Jul 06 15:35:04.634129 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.634102 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.634235 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.634175 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.634235 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.634216 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w5gm\" (UniqueName: \"kubernetes.io/projected/c8278c72-8b16-488e-b970-cd566e079a7a-kube-api-access-2w5gm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.735193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.735167 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w5gm\" (UniqueName: \"kubernetes.io/projected/c8278c72-8b16-488e-b970-cd566e079a7a-kube-api-access-2w5gm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.735332 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.735214 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.735332 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.735260 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.735590 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.735574 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.735651 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.735605 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.748484 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.748458 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w5gm\" (UniqueName: \"kubernetes.io/projected/c8278c72-8b16-488e-b970-cd566e079a7a-kube-api-access-2w5gm\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:04.857207 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:04.857149 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:05.041456 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:05.041429 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm"] Jul 06 15:35:05.043565 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:35:05.043537 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8278c72_8b16_488e_b970_cd566e079a7a.slice/crio-217f90feffa61812ccbea0fc5dcd95d025b022af67caaa976bbb6ead04f6e9b6 WatchSource:0}: Error finding container 217f90feffa61812ccbea0fc5dcd95d025b022af67caaa976bbb6ead04f6e9b6: Status 404 returned error can't find the container with id 217f90feffa61812ccbea0fc5dcd95d025b022af67caaa976bbb6ead04f6e9b6 Jul 06 15:35:05.598478 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:05.598442 2562 generic.go:356] "Generic (PLEG): container finished" podID="c8278c72-8b16-488e-b970-cd566e079a7a" containerID="01813ea9df2dacbf4fb807e034087585fadebe1ec0e75b28a88bad897d40ff26" exitCode=0 Jul 06 15:35:05.598857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:05.598520 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" event={"ID":"c8278c72-8b16-488e-b970-cd566e079a7a","Type":"ContainerDied","Data":"01813ea9df2dacbf4fb807e034087585fadebe1ec0e75b28a88bad897d40ff26"} Jul 06 15:35:05.598857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:05.598571 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" event={"ID":"c8278c72-8b16-488e-b970-cd566e079a7a","Type":"ContainerStarted","Data":"217f90feffa61812ccbea0fc5dcd95d025b022af67caaa976bbb6ead04f6e9b6"} Jul 06 15:35:11.523569 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:11.523539 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b68549bfc-hvwjl"] Jul 06 15:35:11.625192 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:11.625163 2562 generic.go:356] "Generic (PLEG): container finished" podID="c8278c72-8b16-488e-b970-cd566e079a7a" containerID="851fbe1d3ddefbc276c6e9a50933287c0a54eab9149a2883e4190c0277395d26" exitCode=0 Jul 06 15:35:11.625345 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:11.625231 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" event={"ID":"c8278c72-8b16-488e-b970-cd566e079a7a","Type":"ContainerDied","Data":"851fbe1d3ddefbc276c6e9a50933287c0a54eab9149a2883e4190c0277395d26"} Jul 06 15:35:12.631705 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:12.631668 2562 generic.go:356] "Generic (PLEG): container finished" podID="c8278c72-8b16-488e-b970-cd566e079a7a" containerID="d8231af19f87dc45ae752bc437e01fea94f4a9cbc93ebcc24f2b7181ef761240" exitCode=0 Jul 06 15:35:12.632151 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:12.631752 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" event={"ID":"c8278c72-8b16-488e-b970-cd566e079a7a","Type":"ContainerDied","Data":"d8231af19f87dc45ae752bc437e01fea94f4a9cbc93ebcc24f2b7181ef761240"} Jul 06 15:35:13.763501 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.763475 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:13.912993 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.912918 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w5gm\" (UniqueName: \"kubernetes.io/projected/c8278c72-8b16-488e-b970-cd566e079a7a-kube-api-access-2w5gm\") pod \"c8278c72-8b16-488e-b970-cd566e079a7a\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " Jul 06 15:35:13.913159 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.913024 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-util\") pod \"c8278c72-8b16-488e-b970-cd566e079a7a\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " Jul 06 15:35:13.913159 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.913045 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-bundle\") pod \"c8278c72-8b16-488e-b970-cd566e079a7a\" (UID: \"c8278c72-8b16-488e-b970-cd566e079a7a\") " Jul 06 15:35:13.913446 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.913420 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-bundle" (OuterVolumeSpecName: "bundle") pod "c8278c72-8b16-488e-b970-cd566e079a7a" (UID: "c8278c72-8b16-488e-b970-cd566e079a7a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:13.914899 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.914876 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8278c72-8b16-488e-b970-cd566e079a7a-kube-api-access-2w5gm" (OuterVolumeSpecName: "kube-api-access-2w5gm") pod "c8278c72-8b16-488e-b970-cd566e079a7a" (UID: "c8278c72-8b16-488e-b970-cd566e079a7a"). InnerVolumeSpecName "kube-api-access-2w5gm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:13.917623 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:13.917602 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-util" (OuterVolumeSpecName: "util") pod "c8278c72-8b16-488e-b970-cd566e079a7a" (UID: "c8278c72-8b16-488e-b970-cd566e079a7a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:14.014070 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:14.014042 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:14.014070 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:14.014065 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8278c72-8b16-488e-b970-cd566e079a7a-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:14.014070 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:14.014093 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w5gm\" (UniqueName: \"kubernetes.io/projected/c8278c72-8b16-488e-b970-cd566e079a7a-kube-api-access-2w5gm\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:14.642392 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:14.642359 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" event={"ID":"c8278c72-8b16-488e-b970-cd566e079a7a","Type":"ContainerDied","Data":"217f90feffa61812ccbea0fc5dcd95d025b022af67caaa976bbb6ead04f6e9b6"} Jul 06 15:35:14.642556 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:14.642399 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqx8qm" Jul 06 15:35:14.642556 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:14.642407 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="217f90feffa61812ccbea0fc5dcd95d025b022af67caaa976bbb6ead04f6e9b6" Jul 06 15:35:16.524220 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524188 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k"] Jul 06 15:35:16.524595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524503 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="util" Jul 06 15:35:16.524595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524514 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="util" Jul 06 15:35:16.524595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524523 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="extract" Jul 06 15:35:16.524595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524529 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="extract" Jul 06 15:35:16.524595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524553 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="pull" Jul 06 15:35:16.524595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524559 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="pull" Jul 06 15:35:16.524840 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.524605 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8278c72-8b16-488e-b970-cd566e079a7a" containerName="extract" Jul 06 15:35:16.528009 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.527989 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.531956 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.531938 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-c9mhg\"" Jul 06 15:35:16.532224 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.532204 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 06 15:35:16.533012 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.532992 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 06 15:35:16.545751 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.545728 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k"] Jul 06 15:35:16.634714 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.634686 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34fa9d82-15aa-4c55-b789-d6211241f485-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fcf7k\" (UID: \"34fa9d82-15aa-4c55-b789-d6211241f485\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.634840 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.634722 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqvnw\" (UniqueName: \"kubernetes.io/projected/34fa9d82-15aa-4c55-b789-d6211241f485-kube-api-access-pqvnw\") pod \"openshift-lws-operator-fd8ccff4c-fcf7k\" (UID: \"34fa9d82-15aa-4c55-b789-d6211241f485\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.736020 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.735986 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34fa9d82-15aa-4c55-b789-d6211241f485-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fcf7k\" (UID: \"34fa9d82-15aa-4c55-b789-d6211241f485\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.736189 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.736026 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqvnw\" (UniqueName: \"kubernetes.io/projected/34fa9d82-15aa-4c55-b789-d6211241f485-kube-api-access-pqvnw\") pod \"openshift-lws-operator-fd8ccff4c-fcf7k\" (UID: \"34fa9d82-15aa-4c55-b789-d6211241f485\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.736406 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.736386 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34fa9d82-15aa-4c55-b789-d6211241f485-tmp\") pod \"openshift-lws-operator-fd8ccff4c-fcf7k\" (UID: \"34fa9d82-15aa-4c55-b789-d6211241f485\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.750327 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.750300 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqvnw\" (UniqueName: \"kubernetes.io/projected/34fa9d82-15aa-4c55-b789-d6211241f485-kube-api-access-pqvnw\") pod \"openshift-lws-operator-fd8ccff4c-fcf7k\" (UID: \"34fa9d82-15aa-4c55-b789-d6211241f485\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:16.837138 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:16.837051 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" Jul 06 15:35:17.012835 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:17.012804 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k"] Jul 06 15:35:17.030788 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:35:17.030750 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod34fa9d82_15aa_4c55_b789_d6211241f485.slice/crio-2e530053a46cf9a306926ab3f06bb7a2f986a8cb1248b5f970554f45f99b554b WatchSource:0}: Error finding container 2e530053a46cf9a306926ab3f06bb7a2f986a8cb1248b5f970554f45f99b554b: Status 404 returned error can't find the container with id 2e530053a46cf9a306926ab3f06bb7a2f986a8cb1248b5f970554f45f99b554b Jul 06 15:35:17.656912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:17.656878 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" event={"ID":"34fa9d82-15aa-4c55-b789-d6211241f485","Type":"ContainerStarted","Data":"2e530053a46cf9a306926ab3f06bb7a2f986a8cb1248b5f970554f45f99b554b"} Jul 06 15:35:19.667695 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:19.667655 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" event={"ID":"34fa9d82-15aa-4c55-b789-d6211241f485","Type":"ContainerStarted","Data":"f9b8092a3983c9811832b2a4c52d1658dadcaa4495ba6b5efa9698bd74a764be"} Jul 06 15:35:19.700805 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:19.700756 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-fcf7k" podStartSLOduration=1.594965314 podStartE2EDuration="3.70074184s" totalImagesPullingTime="2.105776526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:35:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:35:19.697328282 +0000 UTC m=+578.955533757" watchObservedRunningTime="2026-07-06 15:35:19.70074184 +0000 UTC m=+578.958947313" Jul 06 15:35:33.575883 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.575849 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk"] Jul 06 15:35:33.579209 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.579192 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.583758 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.583730 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 06 15:35:33.583872 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.583767 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 06 15:35:33.583935 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.583894 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 06 15:35:33.583993 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.583962 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 06 15:35:33.585028 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.585011 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-8fhkx\"" Jul 06 15:35:33.609681 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.609656 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk"] Jul 06 15:35:33.684206 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684178 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69a364e8-1295-4843-a063-177b9fde0416-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.684326 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684215 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.684326 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684241 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.684326 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684260 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vsng\" (UniqueName: \"kubernetes.io/projected/69a364e8-1295-4843-a063-177b9fde0416-kube-api-access-4vsng\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.684469 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684323 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/69a364e8-1295-4843-a063-177b9fde0416-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.684469 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684374 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.684469 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.684412 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/69a364e8-1295-4843-a063-177b9fde0416-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784651 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/69a364e8-1295-4843-a063-177b9fde0416-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784809 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784701 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784809 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784739 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/69a364e8-1295-4843-a063-177b9fde0416-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784809 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784778 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69a364e8-1295-4843-a063-177b9fde0416-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784815 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784856 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.784964 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.784884 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vsng\" (UniqueName: \"kubernetes.io/projected/69a364e8-1295-4843-a063-177b9fde0416-kube-api-access-4vsng\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.785314 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.785290 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/69a364e8-1295-4843-a063-177b9fde0416-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.786946 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.786926 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/69a364e8-1295-4843-a063-177b9fde0416-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.787029 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.786988 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.787411 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.787391 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.787482 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.787469 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/69a364e8-1295-4843-a063-177b9fde0416-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.799329 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.799304 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/69a364e8-1295-4843-a063-177b9fde0416-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.809676 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.809648 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vsng\" (UniqueName: \"kubernetes.io/projected/69a364e8-1295-4843-a063-177b9fde0416-kube-api-access-4vsng\") pod \"istiod-openshift-gateway-94bb8fbfd-grzgk\" (UID: \"69a364e8-1295-4843-a063-177b9fde0416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:33.888510 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:33.888438 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:34.030532 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:35:34.030503 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a364e8_1295_4843_a063_177b9fde0416.slice/crio-1f860c0f310f4a294bf21b9e80a8bdede3895c71056f957ca70c1b5c3d1d3902 WatchSource:0}: Error finding container 1f860c0f310f4a294bf21b9e80a8bdede3895c71056f957ca70c1b5c3d1d3902: Status 404 returned error can't find the container with id 1f860c0f310f4a294bf21b9e80a8bdede3895c71056f957ca70c1b5c3d1d3902 Jul 06 15:35:34.031324 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:34.031296 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk"] Jul 06 15:35:34.734946 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:34.734909 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" event={"ID":"69a364e8-1295-4843-a063-177b9fde0416","Type":"ContainerStarted","Data":"1f860c0f310f4a294bf21b9e80a8bdede3895c71056f957ca70c1b5c3d1d3902"} Jul 06 15:35:36.542864 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:36.542806 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-b68549bfc-hvwjl" podUID="01f381be-2cbb-4d7e-85f1-c7feebffd16a" containerName="console" containerID="cri-o://db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f" gracePeriod=15 Jul 06 15:35:37.141530 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.141474 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 15:35:37.141651 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.141564 2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 06 15:35:37.220301 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.220283 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:35:37.315072 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315043 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-oauth-config\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315270 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315099 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-config\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315270 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315145 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqpjq\" (UniqueName: \"kubernetes.io/projected/01f381be-2cbb-4d7e-85f1-c7feebffd16a-kube-api-access-dqpjq\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315270 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315255 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-oauth-serving-cert\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315441 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315285 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-serving-cert\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315441 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315333 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-service-ca\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315441 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315369 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-trusted-ca-bundle\") pod \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\" (UID: \"01f381be-2cbb-4d7e-85f1-c7feebffd16a\") " Jul 06 15:35:37.315589 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315484 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-config" (OuterVolumeSpecName: "console-config") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:37.315663 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315644 2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.315725 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315626 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:37.315785 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315723 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-service-ca" (OuterVolumeSpecName: "service-ca") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:37.315838 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.315814 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:35:37.317346 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.317320 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01f381be-2cbb-4d7e-85f1-c7feebffd16a-kube-api-access-dqpjq" (OuterVolumeSpecName: "kube-api-access-dqpjq") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "kube-api-access-dqpjq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:37.317346 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.317322 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:35:37.317532 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.317351 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "01f381be-2cbb-4d7e-85f1-c7feebffd16a" (UID: "01f381be-2cbb-4d7e-85f1-c7feebffd16a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 06 15:35:37.416839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.416775 2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-trusted-ca-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.416839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.416800 2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-oauth-config\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.416839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.416810 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqpjq\" (UniqueName: \"kubernetes.io/projected/01f381be-2cbb-4d7e-85f1-c7feebffd16a-kube-api-access-dqpjq\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.416839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.416819 2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-oauth-serving-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.416839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.416828 2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/01f381be-2cbb-4d7e-85f1-c7feebffd16a-console-serving-cert\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.416839 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.416836 2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/01f381be-2cbb-4d7e-85f1-c7feebffd16a-service-ca\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:37.751143 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.751049 2562 generic.go:356] "Generic (PLEG): container finished" podID="01f381be-2cbb-4d7e-85f1-c7feebffd16a" containerID="db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f" exitCode=0 Jul 06 15:35:37.751143 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.751122 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b68549bfc-hvwjl" Jul 06 15:35:37.751615 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.751134 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68549bfc-hvwjl" event={"ID":"01f381be-2cbb-4d7e-85f1-c7feebffd16a","Type":"ContainerDied","Data":"db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f"} Jul 06 15:35:37.751615 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.751195 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b68549bfc-hvwjl" event={"ID":"01f381be-2cbb-4d7e-85f1-c7feebffd16a","Type":"ContainerDied","Data":"182d0cbfc171907782ae3b42b9eaf9f4ad913964ed6764c4fe944d674f3816f2"} Jul 06 15:35:37.751615 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.751221 2562 scope.go:117] "RemoveContainer" containerID="db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f" Jul 06 15:35:37.753017 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.752987 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" event={"ID":"69a364e8-1295-4843-a063-177b9fde0416","Type":"ContainerStarted","Data":"789e1074e60e157b106fda7557de0c8b10ffeb8048ea987d39ae54b0d8b5ccb2"} Jul 06 15:35:37.753244 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.753044 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:37.760847 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.760830 2562 scope.go:117] "RemoveContainer" containerID="db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f" Jul 06 15:35:37.761101 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:35:37.761069 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f\": container with ID starting with db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f not found: ID does not exist" containerID="db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f" Jul 06 15:35:37.761159 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.761112 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f"} err="failed to get container status \"db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f\": rpc error: code = NotFound desc = could not find container \"db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f\": container with ID starting with db0a4033219bb9b1c90cf2ff342a535babbf63c2749c81937ab7ac608237782f not found: ID does not exist" Jul 06 15:35:37.790584 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.790544 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" podStartSLOduration=1.681761434 podStartE2EDuration="4.790530915s" totalImagesPullingTime="3.108769481s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:35:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:35:37.789273346 +0000 UTC m=+597.047478822" watchObservedRunningTime="2026-07-06 15:35:37.790530915 +0000 UTC m=+597.048736389" Jul 06 15:35:37.812469 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.812448 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b68549bfc-hvwjl"] Jul 06 15:35:37.815662 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:37.815643 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b68549bfc-hvwjl"] Jul 06 15:35:38.760737 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:38.760707 2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-grzgk container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 06 15:35:38.761172 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:38.760762 2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" podUID="69a364e8-1295-4843-a063-177b9fde0416" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 06 15:35:39.258176 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:39.258140 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01f381be-2cbb-4d7e-85f1-c7feebffd16a" path="/var/lib/kubelet/pods/01f381be-2cbb-4d7e-85f1-c7feebffd16a/volumes" Jul 06 15:35:41.759550 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:41.759523 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-grzgk" Jul 06 15:35:52.240674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.240640 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2"] Jul 06 15:35:52.241131 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.240944 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01f381be-2cbb-4d7e-85f1-c7feebffd16a" containerName="console" Jul 06 15:35:52.241131 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.240955 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="01f381be-2cbb-4d7e-85f1-c7feebffd16a" containerName="console" Jul 06 15:35:52.241131 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.241014 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="01f381be-2cbb-4d7e-85f1-c7feebffd16a" containerName="console" Jul 06 15:35:52.246785 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.246768 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.251690 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.251670 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 06 15:35:52.251793 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.251737 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-b5r6f\"" Jul 06 15:35:52.252481 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.252468 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 06 15:35:52.263848 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.263827 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2"] Jul 06 15:35:52.333918 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.333886 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmf2l\" (UniqueName: \"kubernetes.io/projected/02e15916-4434-4a3d-8035-c1ddd216c799-kube-api-access-kmf2l\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.334125 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.333961 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.334125 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.333993 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.376952 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.376927 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6"] Jul 06 15:35:52.380966 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.380951 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.402116 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.402089 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6"] Jul 06 15:35:52.435091 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435059 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.435222 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435112 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.435222 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435179 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xnz\" (UniqueName: \"kubernetes.io/projected/f47fba77-81fb-4b38-861d-1cafeb66df31-kube-api-access-b5xnz\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.435222 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435207 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.435357 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435233 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmf2l\" (UniqueName: \"kubernetes.io/projected/02e15916-4434-4a3d-8035-c1ddd216c799-kube-api-access-kmf2l\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.435412 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.435412 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435387 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-bundle\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.435642 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.435622 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-util\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.449887 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.449866 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmf2l\" (UniqueName: \"kubernetes.io/projected/02e15916-4434-4a3d-8035-c1ddd216c799-kube-api-access-kmf2l\") pod \"f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.484808 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.484781 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg"] Jul 06 15:35:52.488877 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.488858 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.506396 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.506371 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg"] Jul 06 15:35:52.536194 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.536170 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.536278 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.536234 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.536317 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.536285 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xnz\" (UniqueName: \"kubernetes.io/projected/f47fba77-81fb-4b38-861d-1cafeb66df31-kube-api-access-b5xnz\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.536513 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.536496 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-util\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.536553 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.536540 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-bundle\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.552630 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.552610 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xnz\" (UniqueName: \"kubernetes.io/projected/f47fba77-81fb-4b38-861d-1cafeb66df31-kube-api-access-b5xnz\") pod \"af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.555417 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.555401 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:52.637680 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.637647 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.637821 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.637750 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.637821 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.637783 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmdxk\" (UniqueName: \"kubernetes.io/projected/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-kube-api-access-wmdxk\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.655792 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.655768 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw"] Jul 06 15:35:52.660792 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.660773 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.677272 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.677245 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw"] Jul 06 15:35:52.689504 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.689486 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:52.712695 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.712661 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2"] Jul 06 15:35:52.713009 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:35:52.712986 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e15916_4434_4a3d_8035_c1ddd216c799.slice/crio-b76d20006d086bb962ce6fae524585b4a6f569f2cdcbec9ccebb94d30b385b27 WatchSource:0}: Error finding container b76d20006d086bb962ce6fae524585b4a6f569f2cdcbec9ccebb94d30b385b27: Status 404 returned error can't find the container with id b76d20006d086bb962ce6fae524585b4a6f569f2cdcbec9ccebb94d30b385b27 Jul 06 15:35:52.738948 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.738917 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.739062 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.738984 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.739062 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.739024 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.739062 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.739048 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42bm\" (UniqueName: \"kubernetes.io/projected/3bc985d4-a637-4333-a3e3-ff8089ef0500-kube-api-access-c42bm\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.739250 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.739109 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmdxk\" (UniqueName: \"kubernetes.io/projected/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-kube-api-access-wmdxk\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.739250 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.739156 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.739675 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.739534 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-util\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.739675 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.739633 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-bundle\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.760943 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.760914 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmdxk\" (UniqueName: \"kubernetes.io/projected/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-kube-api-access-wmdxk\") pod \"0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.798228 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.798198 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:52.822769 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.822732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" event={"ID":"02e15916-4434-4a3d-8035-c1ddd216c799","Type":"ContainerStarted","Data":"2d165d518f675cae9c3475e3bc86bdb2298aa566fb01320437bdc38c09330ccb"} Jul 06 15:35:52.822931 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.822800 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" event={"ID":"02e15916-4434-4a3d-8035-c1ddd216c799","Type":"ContainerStarted","Data":"b76d20006d086bb962ce6fae524585b4a6f569f2cdcbec9ccebb94d30b385b27"} Jul 06 15:35:52.840287 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.840262 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.840421 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.840310 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42bm\" (UniqueName: \"kubernetes.io/projected/3bc985d4-a637-4333-a3e3-ff8089ef0500-kube-api-access-c42bm\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.840421 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.840355 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.840660 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.840636 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-bundle\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.840735 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.840668 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-util\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.868310 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.868272 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42bm\" (UniqueName: \"kubernetes.io/projected/3bc985d4-a637-4333-a3e3-ff8089ef0500-kube-api-access-c42bm\") pod \"299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:52.869156 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.869137 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6"] Jul 06 15:35:52.892408 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:35:52.892379 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf47fba77_81fb_4b38_861d_1cafeb66df31.slice/crio-79839fc9f170b6f15409d09d587027a2ac1fe3a7cfdf4e822f61de2bf9a7529d WatchSource:0}: Error finding container 79839fc9f170b6f15409d09d587027a2ac1fe3a7cfdf4e822f61de2bf9a7529d: Status 404 returned error can't find the container with id 79839fc9f170b6f15409d09d587027a2ac1fe3a7cfdf4e822f61de2bf9a7529d Jul 06 15:35:52.951694 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.951431 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg"] Jul 06 15:35:52.970735 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:52.970715 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:53.113426 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.113405 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw"] Jul 06 15:35:53.118895 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:35:53.118875 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bc985d4_a637_4333_a3e3_ff8089ef0500.slice/crio-4ad34a6d847497bf7a555d56a13656faea2b11c21af726943aba81e253f85663 WatchSource:0}: Error finding container 4ad34a6d847497bf7a555d56a13656faea2b11c21af726943aba81e253f85663: Status 404 returned error can't find the container with id 4ad34a6d847497bf7a555d56a13656faea2b11c21af726943aba81e253f85663 Jul 06 15:35:53.828890 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.828838 2562 generic.go:356] "Generic (PLEG): container finished" podID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerID="e6bb797f069f7cf4864667dc813db97c092b35d48966a9d88adfbbc1829917ad" exitCode=0 Jul 06 15:35:53.829379 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.828897 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" event={"ID":"3bc985d4-a637-4333-a3e3-ff8089ef0500","Type":"ContainerDied","Data":"e6bb797f069f7cf4864667dc813db97c092b35d48966a9d88adfbbc1829917ad"} Jul 06 15:35:53.829379 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.828944 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" event={"ID":"3bc985d4-a637-4333-a3e3-ff8089ef0500","Type":"ContainerStarted","Data":"4ad34a6d847497bf7a555d56a13656faea2b11c21af726943aba81e253f85663"} Jul 06 15:35:53.830655 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.830632 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerID="c0120d978fa1c34ef1df7b7e4049c4ad8178682ddaa1e763193371a43f8300d3" exitCode=0 Jul 06 15:35:53.830743 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.830716 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" event={"ID":"0ffb8584-8c5c-44b2-8c27-463ab2e3035d","Type":"ContainerDied","Data":"c0120d978fa1c34ef1df7b7e4049c4ad8178682ddaa1e763193371a43f8300d3"} Jul 06 15:35:53.830817 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.830803 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" event={"ID":"0ffb8584-8c5c-44b2-8c27-463ab2e3035d","Type":"ContainerStarted","Data":"60ce2af883f7492266cf08784d085dafdce8be02e0ba04dfb7692e965375018b"} Jul 06 15:35:53.832229 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.832211 2562 generic.go:356] "Generic (PLEG): container finished" podID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerID="35017cb523f8273bd79ccfb464ed31d0f4d87486d7c4ae7baa48b89b84bb4fe9" exitCode=0 Jul 06 15:35:53.832318 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.832299 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" event={"ID":"f47fba77-81fb-4b38-861d-1cafeb66df31","Type":"ContainerDied","Data":"35017cb523f8273bd79ccfb464ed31d0f4d87486d7c4ae7baa48b89b84bb4fe9"} Jul 06 15:35:53.832394 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.832356 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" event={"ID":"f47fba77-81fb-4b38-861d-1cafeb66df31","Type":"ContainerStarted","Data":"79839fc9f170b6f15409d09d587027a2ac1fe3a7cfdf4e822f61de2bf9a7529d"} Jul 06 15:35:53.833946 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.833928 2562 generic.go:356] "Generic (PLEG): container finished" podID="02e15916-4434-4a3d-8035-c1ddd216c799" containerID="2d165d518f675cae9c3475e3bc86bdb2298aa566fb01320437bdc38c09330ccb" exitCode=0 Jul 06 15:35:53.834034 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:53.833954 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" event={"ID":"02e15916-4434-4a3d-8035-c1ddd216c799","Type":"ContainerDied","Data":"2d165d518f675cae9c3475e3bc86bdb2298aa566fb01320437bdc38c09330ccb"} Jul 06 15:35:54.841516 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:54.841482 2562 generic.go:356] "Generic (PLEG): container finished" podID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerID="fd374073e61a1bad6dc14ef50edc2db68b2f97868c821fa61d28de2db689b2a6" exitCode=0 Jul 06 15:35:54.841879 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:54.841570 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" event={"ID":"3bc985d4-a637-4333-a3e3-ff8089ef0500","Type":"ContainerDied","Data":"fd374073e61a1bad6dc14ef50edc2db68b2f97868c821fa61d28de2db689b2a6"} Jul 06 15:35:55.848106 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.848061 2562 generic.go:356] "Generic (PLEG): container finished" podID="02e15916-4434-4a3d-8035-c1ddd216c799" containerID="081bb141ee5aedb050a873a578bf33b6d0ee04b67b3eb381129f43f0f5092c1a" exitCode=0 Jul 06 15:35:55.848530 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.848150 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" event={"ID":"02e15916-4434-4a3d-8035-c1ddd216c799","Type":"ContainerDied","Data":"081bb141ee5aedb050a873a578bf33b6d0ee04b67b3eb381129f43f0f5092c1a"} Jul 06 15:35:55.850638 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.850605 2562 generic.go:356] "Generic (PLEG): container finished" podID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerID="ddac3b49279879ea1e8d1384e71b6eb890f83c46370de3663053cdecefca076c" exitCode=0 Jul 06 15:35:55.850764 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.850732 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" event={"ID":"3bc985d4-a637-4333-a3e3-ff8089ef0500","Type":"ContainerDied","Data":"ddac3b49279879ea1e8d1384e71b6eb890f83c46370de3663053cdecefca076c"} Jul 06 15:35:55.857693 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.857671 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerID="4851fb029878e595898035b7c1c7073b41d7578750c8afe8beec5c0f4554aa7d" exitCode=0 Jul 06 15:35:55.857791 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.857721 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" event={"ID":"0ffb8584-8c5c-44b2-8c27-463ab2e3035d","Type":"ContainerDied","Data":"4851fb029878e595898035b7c1c7073b41d7578750c8afe8beec5c0f4554aa7d"} Jul 06 15:35:55.859599 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.859579 2562 generic.go:356] "Generic (PLEG): container finished" podID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerID="56d8d6aafb97fe83d4ae4779b87604e49f82afb5a9aafca98660903bd0f83dd0" exitCode=0 Jul 06 15:35:55.859696 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:55.859604 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" event={"ID":"f47fba77-81fb-4b38-861d-1cafeb66df31","Type":"ContainerDied","Data":"56d8d6aafb97fe83d4ae4779b87604e49f82afb5a9aafca98660903bd0f83dd0"} Jul 06 15:35:56.865979 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.865944 2562 generic.go:356] "Generic (PLEG): container finished" podID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerID="5daf34bb0d8be254f869701292b51c90e4e15ef82bf0c0b22902285b0980d04a" exitCode=0 Jul 06 15:35:56.866442 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.866015 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" event={"ID":"0ffb8584-8c5c-44b2-8c27-463ab2e3035d","Type":"ContainerDied","Data":"5daf34bb0d8be254f869701292b51c90e4e15ef82bf0c0b22902285b0980d04a"} Jul 06 15:35:56.867882 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.867859 2562 generic.go:356] "Generic (PLEG): container finished" podID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerID="905ab4b8c40ba04349b28b9ede574bb97d2aeb32f8a92d51104e6560fdee26fc" exitCode=0 Jul 06 15:35:56.868001 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.867913 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" event={"ID":"f47fba77-81fb-4b38-861d-1cafeb66df31","Type":"ContainerDied","Data":"905ab4b8c40ba04349b28b9ede574bb97d2aeb32f8a92d51104e6560fdee26fc"} Jul 06 15:35:56.869684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.869664 2562 generic.go:356] "Generic (PLEG): container finished" podID="02e15916-4434-4a3d-8035-c1ddd216c799" containerID="6457f53dae549c8bc828c839f32f7ee5e7f77fe5e0854ca5415152d93d27c112" exitCode=0 Jul 06 15:35:56.869776 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.869737 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" event={"ID":"02e15916-4434-4a3d-8035-c1ddd216c799","Type":"ContainerDied","Data":"6457f53dae549c8bc828c839f32f7ee5e7f77fe5e0854ca5415152d93d27c112"} Jul 06 15:35:56.992041 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:56.992019 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:57.075674 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.075648 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c42bm\" (UniqueName: \"kubernetes.io/projected/3bc985d4-a637-4333-a3e3-ff8089ef0500-kube-api-access-c42bm\") pod \"3bc985d4-a637-4333-a3e3-ff8089ef0500\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " Jul 06 15:35:57.075823 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.075703 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-bundle\") pod \"3bc985d4-a637-4333-a3e3-ff8089ef0500\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " Jul 06 15:35:57.075823 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.075751 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-util\") pod \"3bc985d4-a637-4333-a3e3-ff8089ef0500\" (UID: \"3bc985d4-a637-4333-a3e3-ff8089ef0500\") " Jul 06 15:35:57.076229 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.076207 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-bundle" (OuterVolumeSpecName: "bundle") pod "3bc985d4-a637-4333-a3e3-ff8089ef0500" (UID: "3bc985d4-a637-4333-a3e3-ff8089ef0500"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:57.077771 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.077739 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bc985d4-a637-4333-a3e3-ff8089ef0500-kube-api-access-c42bm" (OuterVolumeSpecName: "kube-api-access-c42bm") pod "3bc985d4-a637-4333-a3e3-ff8089ef0500" (UID: "3bc985d4-a637-4333-a3e3-ff8089ef0500"). InnerVolumeSpecName "kube-api-access-c42bm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:57.081129 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.081104 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-util" (OuterVolumeSpecName: "util") pod "3bc985d4-a637-4333-a3e3-ff8089ef0500" (UID: "3bc985d4-a637-4333-a3e3-ff8089ef0500"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:57.176919 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.176838 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:57.176919 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.176865 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c42bm\" (UniqueName: \"kubernetes.io/projected/3bc985d4-a637-4333-a3e3-ff8089ef0500-kube-api-access-c42bm\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:57.176919 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.176876 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bc985d4-a637-4333-a3e3-ff8089ef0500-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:57.876830 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.876803 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" Jul 06 15:35:57.877270 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.876843 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/299160ebe81f164e400242457c5a1580453e7d84fd8087b72a6eb317ef86psw" event={"ID":"3bc985d4-a637-4333-a3e3-ff8089ef0500","Type":"ContainerDied","Data":"4ad34a6d847497bf7a555d56a13656faea2b11c21af726943aba81e253f85663"} Jul 06 15:35:57.877270 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:57.876886 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4ad34a6d847497bf7a555d56a13656faea2b11c21af726943aba81e253f85663" Jul 06 15:35:58.018449 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.018424 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:58.062828 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.062807 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:58.065796 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.065774 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:58.084499 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.084473 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmdxk\" (UniqueName: \"kubernetes.io/projected/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-kube-api-access-wmdxk\") pod \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " Jul 06 15:35:58.084618 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.084538 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-bundle\") pod \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " Jul 06 15:35:58.084688 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.084640 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-util\") pod \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\" (UID: \"0ffb8584-8c5c-44b2-8c27-463ab2e3035d\") " Jul 06 15:35:58.084999 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.084979 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-bundle" (OuterVolumeSpecName: "bundle") pod "0ffb8584-8c5c-44b2-8c27-463ab2e3035d" (UID: "0ffb8584-8c5c-44b2-8c27-463ab2e3035d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:58.086508 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.086483 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-kube-api-access-wmdxk" (OuterVolumeSpecName: "kube-api-access-wmdxk") pod "0ffb8584-8c5c-44b2-8c27-463ab2e3035d" (UID: "0ffb8584-8c5c-44b2-8c27-463ab2e3035d"). InnerVolumeSpecName "kube-api-access-wmdxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:58.090334 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.090306 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-util" (OuterVolumeSpecName: "util") pod "0ffb8584-8c5c-44b2-8c27-463ab2e3035d" (UID: "0ffb8584-8c5c-44b2-8c27-463ab2e3035d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:58.185694 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.185618 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-util\") pod \"f47fba77-81fb-4b38-861d-1cafeb66df31\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " Jul 06 15:35:58.185844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.185710 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5xnz\" (UniqueName: \"kubernetes.io/projected/f47fba77-81fb-4b38-861d-1cafeb66df31-kube-api-access-b5xnz\") pod \"f47fba77-81fb-4b38-861d-1cafeb66df31\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " Jul 06 15:35:58.185844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.185746 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmf2l\" (UniqueName: \"kubernetes.io/projected/02e15916-4434-4a3d-8035-c1ddd216c799-kube-api-access-kmf2l\") pod \"02e15916-4434-4a3d-8035-c1ddd216c799\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " Jul 06 15:35:58.185844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.185780 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-util\") pod \"02e15916-4434-4a3d-8035-c1ddd216c799\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " Jul 06 15:35:58.185844 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.185817 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-bundle\") pod \"02e15916-4434-4a3d-8035-c1ddd216c799\" (UID: \"02e15916-4434-4a3d-8035-c1ddd216c799\") " Jul 06 15:35:58.186033 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.185869 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-bundle\") pod \"f47fba77-81fb-4b38-861d-1cafeb66df31\" (UID: \"f47fba77-81fb-4b38-861d-1cafeb66df31\") " Jul 06 15:35:58.186128 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.186110 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.186189 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.186132 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.186189 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.186145 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmdxk\" (UniqueName: \"kubernetes.io/projected/0ffb8584-8c5c-44b2-8c27-463ab2e3035d-kube-api-access-wmdxk\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.186656 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.186628 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-bundle" (OuterVolumeSpecName: "bundle") pod "02e15916-4434-4a3d-8035-c1ddd216c799" (UID: "02e15916-4434-4a3d-8035-c1ddd216c799"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:58.186721 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.186631 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-bundle" (OuterVolumeSpecName: "bundle") pod "f47fba77-81fb-4b38-861d-1cafeb66df31" (UID: "f47fba77-81fb-4b38-861d-1cafeb66df31"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:58.187860 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.187837 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02e15916-4434-4a3d-8035-c1ddd216c799-kube-api-access-kmf2l" (OuterVolumeSpecName: "kube-api-access-kmf2l") pod "02e15916-4434-4a3d-8035-c1ddd216c799" (UID: "02e15916-4434-4a3d-8035-c1ddd216c799"). InnerVolumeSpecName "kube-api-access-kmf2l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:58.188163 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.188142 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f47fba77-81fb-4b38-861d-1cafeb66df31-kube-api-access-b5xnz" (OuterVolumeSpecName: "kube-api-access-b5xnz") pod "f47fba77-81fb-4b38-861d-1cafeb66df31" (UID: "f47fba77-81fb-4b38-861d-1cafeb66df31"). InnerVolumeSpecName "kube-api-access-b5xnz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:35:58.191558 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.191536 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-util" (OuterVolumeSpecName: "util") pod "02e15916-4434-4a3d-8035-c1ddd216c799" (UID: "02e15916-4434-4a3d-8035-c1ddd216c799"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:58.191634 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.191618 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-util" (OuterVolumeSpecName: "util") pod "f47fba77-81fb-4b38-861d-1cafeb66df31" (UID: "f47fba77-81fb-4b38-861d-1cafeb66df31"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 06 15:35:58.287003 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.286979 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.287003 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.287000 2562 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-bundle\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.287003 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.287008 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f47fba77-81fb-4b38-861d-1cafeb66df31-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.287223 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.287016 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5xnz\" (UniqueName: \"kubernetes.io/projected/f47fba77-81fb-4b38-861d-1cafeb66df31-kube-api-access-b5xnz\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.287223 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.287026 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmf2l\" (UniqueName: \"kubernetes.io/projected/02e15916-4434-4a3d-8035-c1ddd216c799-kube-api-access-kmf2l\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.287223 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.287034 2562 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/02e15916-4434-4a3d-8035-c1ddd216c799-util\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:35:58.884400 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.884372 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" Jul 06 15:35:58.884857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.884366 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/0e9e3357d40614682d1ebdb402e8ba62e1e258fb473e6f54140aafff36tn8hg" event={"ID":"0ffb8584-8c5c-44b2-8c27-463ab2e3035d","Type":"ContainerDied","Data":"60ce2af883f7492266cf08784d085dafdce8be02e0ba04dfb7692e965375018b"} Jul 06 15:35:58.884857 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.884506 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60ce2af883f7492266cf08784d085dafdce8be02e0ba04dfb7692e965375018b" Jul 06 15:35:58.886203 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.886182 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" Jul 06 15:35:58.886349 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.886206 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/af2a5cb5935dca7d5808b44f590e0d3d1363f94abbf5c1d8a71e95fcabzzsg6" event={"ID":"f47fba77-81fb-4b38-861d-1cafeb66df31","Type":"ContainerDied","Data":"79839fc9f170b6f15409d09d587027a2ac1fe3a7cfdf4e822f61de2bf9a7529d"} Jul 06 15:35:58.886349 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.886245 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="79839fc9f170b6f15409d09d587027a2ac1fe3a7cfdf4e822f61de2bf9a7529d" Jul 06 15:35:58.888155 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.888137 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" Jul 06 15:35:58.888278 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.888161 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/f13fb8b568e19b60b32189bed3ab51e2b7cfe62efa490862cd57eead76vzkh2" event={"ID":"02e15916-4434-4a3d-8035-c1ddd216c799","Type":"ContainerDied","Data":"b76d20006d086bb962ce6fae524585b4a6f569f2cdcbec9ccebb94d30b385b27"} Jul 06 15:35:58.888278 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:35:58.888190 2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b76d20006d086bb962ce6fae524585b4a6f569f2cdcbec9ccebb94d30b385b27" Jul 06 15:36:03.685170 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685135 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv"] Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685609 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685626 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685634 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685640 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685650 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685657 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685664 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685670 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685683 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685687 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685697 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685702 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685708 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685712 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="pull" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685719 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685724 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685729 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685734 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685739 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685743 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685749 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685753 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685759 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685764 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="util" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685813 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bc985d4-a637-4333-a3e3-ff8089ef0500" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685822 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="02e15916-4434-4a3d-8035-c1ddd216c799" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685828 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f47fba77-81fb-4b38-861d-1cafeb66df31" containerName="extract" Jul 06 15:36:03.687565 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.685836 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ffb8584-8c5c-44b2-8c27-463ab2e3035d" containerName="extract" Jul 06 15:36:03.689563 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.689543 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:03.694071 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.694046 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 06 15:36:03.694071 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.694048 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 06 15:36:03.696310 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.696170 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xpclb\"" Jul 06 15:36:03.696613 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.696591 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 06 15:36:03.707566 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.707542 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv"] Jul 06 15:36:03.835400 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.835368 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpfd8\" (UniqueName: \"kubernetes.io/projected/943ca358-ca8b-438d-a7d2-5e85fb85e9b0-kube-api-access-dpfd8\") pod \"dns-operator-controller-manager-65b49595d7-n9wnv\" (UID: \"943ca358-ca8b-438d-a7d2-5e85fb85e9b0\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:03.936637 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.936548 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpfd8\" (UniqueName: \"kubernetes.io/projected/943ca358-ca8b-438d-a7d2-5e85fb85e9b0-kube-api-access-dpfd8\") pod \"dns-operator-controller-manager-65b49595d7-n9wnv\" (UID: \"943ca358-ca8b-438d-a7d2-5e85fb85e9b0\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:03.955235 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:03.955208 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpfd8\" (UniqueName: \"kubernetes.io/projected/943ca358-ca8b-438d-a7d2-5e85fb85e9b0-kube-api-access-dpfd8\") pod \"dns-operator-controller-manager-65b49595d7-n9wnv\" (UID: \"943ca358-ca8b-438d-a7d2-5e85fb85e9b0\") " pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:04.000881 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:04.000845 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:04.140621 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:04.140592 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv"] Jul 06 15:36:04.142268 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:36:04.142244 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod943ca358_ca8b_438d_a7d2_5e85fb85e9b0.slice/crio-58e5bfed428092d478e34d006f49764237888465c346522980bd7842bb1a6aad WatchSource:0}: Error finding container 58e5bfed428092d478e34d006f49764237888465c346522980bd7842bb1a6aad: Status 404 returned error can't find the container with id 58e5bfed428092d478e34d006f49764237888465c346522980bd7842bb1a6aad Jul 06 15:36:04.917840 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:04.917808 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" event={"ID":"943ca358-ca8b-438d-a7d2-5e85fb85e9b0","Type":"ContainerStarted","Data":"58e5bfed428092d478e34d006f49764237888465c346522980bd7842bb1a6aad"} Jul 06 15:36:05.923804 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:05.923768 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" event={"ID":"943ca358-ca8b-438d-a7d2-5e85fb85e9b0","Type":"ContainerStarted","Data":"42c979e5dfcaf8776ab4eb1ca02ba68c9a28598f91cf5ac2397f8dbb08ca510f"} Jul 06 15:36:05.924195 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:05.923874 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:05.982057 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:05.982009 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" podStartSLOduration=1.291468154 podStartE2EDuration="2.981992505s" totalImagesPullingTime="1.690524351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:36:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:36:05.97494776 +0000 UTC m=+625.233153246" watchObservedRunningTime="2026-07-06 15:36:05.981992505 +0000 UTC m=+625.240197980" Jul 06 15:36:06.457392 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.457359 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-r8nc8"] Jul 06 15:36:06.460561 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.460545 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:06.465758 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.465717 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-jg7j9\"" Jul 06 15:36:06.510949 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.510926 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-r8nc8"] Jul 06 15:36:06.558256 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.558225 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ngzt\" (UniqueName: \"kubernetes.io/projected/e3510cae-18f8-433b-9dee-01cd6c4baef8-kube-api-access-4ngzt\") pod \"authorino-operator-6d85f6564-r8nc8\" (UID: \"e3510cae-18f8-433b-9dee-01cd6c4baef8\") " pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:06.659462 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.659429 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ngzt\" (UniqueName: \"kubernetes.io/projected/e3510cae-18f8-433b-9dee-01cd6c4baef8-kube-api-access-4ngzt\") pod \"authorino-operator-6d85f6564-r8nc8\" (UID: \"e3510cae-18f8-433b-9dee-01cd6c4baef8\") " pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:06.676460 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.676435 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ngzt\" (UniqueName: \"kubernetes.io/projected/e3510cae-18f8-433b-9dee-01cd6c4baef8-kube-api-access-4ngzt\") pod \"authorino-operator-6d85f6564-r8nc8\" (UID: \"e3510cae-18f8-433b-9dee-01cd6c4baef8\") " pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:06.770217 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.770188 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:06.911606 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.911583 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-6d85f6564-r8nc8"] Jul 06 15:36:06.913244 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:36:06.913221 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3510cae_18f8_433b_9dee_01cd6c4baef8.slice/crio-43242ce2ad71f799a1136b84ad6befaaf0b231688ea7fceac693c6f5dcd9c0e2 WatchSource:0}: Error finding container 43242ce2ad71f799a1136b84ad6befaaf0b231688ea7fceac693c6f5dcd9c0e2: Status 404 returned error can't find the container with id 43242ce2ad71f799a1136b84ad6befaaf0b231688ea7fceac693c6f5dcd9c0e2 Jul 06 15:36:06.929818 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:06.929791 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" event={"ID":"e3510cae-18f8-433b-9dee-01cd6c4baef8","Type":"ContainerStarted","Data":"43242ce2ad71f799a1136b84ad6befaaf0b231688ea7fceac693c6f5dcd9c0e2"} Jul 06 15:36:09.948293 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:09.948258 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" event={"ID":"e3510cae-18f8-433b-9dee-01cd6c4baef8","Type":"ContainerStarted","Data":"e0e26d6f88dc45049bfa12bc6f145c29ad566205a1ad2e136f058989c953d67e"} Jul 06 15:36:09.948695 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:09.948330 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:09.985557 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:09.985501 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" podStartSLOduration=1.660572648 podStartE2EDuration="3.985483566s" totalImagesPullingTime="2.324910918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:36:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:36:09.983117246 +0000 UTC m=+629.241322711" watchObservedRunningTime="2026-07-06 15:36:09.985483566 +0000 UTC m=+629.243689037" Jul 06 15:36:11.431517 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.431483 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m"] Jul 06 15:36:11.441682 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.441659 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.467368 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.467349 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-s5gzq\"" Jul 06 15:36:11.494838 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.494805 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m"] Jul 06 15:36:11.601891 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.601862 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxnlw\" (UniqueName: \"kubernetes.io/projected/4b7f4b2b-98ad-4226-93da-424a85517b3f-kube-api-access-zxnlw\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m\" (UID: \"4b7f4b2b-98ad-4226-93da-424a85517b3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.601891 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.601897 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b7f4b2b-98ad-4226-93da-424a85517b3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m\" (UID: \"4b7f4b2b-98ad-4226-93da-424a85517b3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.702463 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.702391 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxnlw\" (UniqueName: \"kubernetes.io/projected/4b7f4b2b-98ad-4226-93da-424a85517b3f-kube-api-access-zxnlw\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m\" (UID: \"4b7f4b2b-98ad-4226-93da-424a85517b3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.702463 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.702421 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b7f4b2b-98ad-4226-93da-424a85517b3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m\" (UID: \"4b7f4b2b-98ad-4226-93da-424a85517b3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.702866 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.702841 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4b7f4b2b-98ad-4226-93da-424a85517b3f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m\" (UID: \"4b7f4b2b-98ad-4226-93da-424a85517b3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.723411 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.723382 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxnlw\" (UniqueName: \"kubernetes.io/projected/4b7f4b2b-98ad-4226-93da-424a85517b3f-kube-api-access-zxnlw\") pod \"kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m\" (UID: \"4b7f4b2b-98ad-4226-93da-424a85517b3f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.751742 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.751714 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:11.906205 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.906184 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m"] Jul 06 15:36:11.907334 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:36:11.907306 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b7f4b2b_98ad_4226_93da_424a85517b3f.slice/crio-1ce94ff510191728f53a2eac367dec98d49a273fcd59d01b471b0f50f963e4e1 WatchSource:0}: Error finding container 1ce94ff510191728f53a2eac367dec98d49a273fcd59d01b471b0f50f963e4e1: Status 404 returned error can't find the container with id 1ce94ff510191728f53a2eac367dec98d49a273fcd59d01b471b0f50f963e4e1 Jul 06 15:36:11.959684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:11.959620 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" event={"ID":"4b7f4b2b-98ad-4226-93da-424a85517b3f","Type":"ContainerStarted","Data":"1ce94ff510191728f53a2eac367dec98d49a273fcd59d01b471b0f50f963e4e1"} Jul 06 15:36:15.983128 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:15.983026 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" event={"ID":"4b7f4b2b-98ad-4226-93da-424a85517b3f","Type":"ContainerStarted","Data":"50a47f495716980448793ef86baa8cc9ad7e0614c921a231d8753772f04c6027"} Jul 06 15:36:15.983128 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:15.983125 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:36:16.019835 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:16.019790 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" podStartSLOduration=1.373918053 podStartE2EDuration="5.019772701s" totalImagesPullingTime="3.645854648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:36:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:36:16.01823645 +0000 UTC m=+635.276441931" watchObservedRunningTime="2026-07-06 15:36:16.019772701 +0000 UTC m=+635.277978178" Jul 06 15:36:16.931698 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:16.931668 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-65b49595d7-n9wnv" Jul 06 15:36:18.494864 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.494830 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d"] Jul 06 15:36:18.498088 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.498065 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.506306 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.506284 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 06 15:36:18.507229 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.507208 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 06 15:36:18.507470 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.507458 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xjsvl\"" Jul 06 15:36:18.520876 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.520855 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d"] Jul 06 15:36:18.566893 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.566867 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4447eb-2e98-47e2-ae6e-ae361ed39922-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.567009 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.566898 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a4447eb-2e98-47e2-ae6e-ae361ed39922-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.567009 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.566927 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mt9q6\" (UniqueName: \"kubernetes.io/projected/3a4447eb-2e98-47e2-ae6e-ae361ed39922-kube-api-access-mt9q6\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.667343 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.667318 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4447eb-2e98-47e2-ae6e-ae361ed39922-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.667457 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.667349 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a4447eb-2e98-47e2-ae6e-ae361ed39922-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.667457 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.667378 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mt9q6\" (UniqueName: \"kubernetes.io/projected/3a4447eb-2e98-47e2-ae6e-ae361ed39922-kube-api-access-mt9q6\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.667529 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:36:18.667452 2562 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 06 15:36:18.667529 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:36:18.667509 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a4447eb-2e98-47e2-ae6e-ae361ed39922-plugin-serving-cert podName:3a4447eb-2e98-47e2-ae6e-ae361ed39922 nodeName:}" failed. No retries permitted until 2026-07-06 15:36:19.167493529 +0000 UTC m=+638.425698981 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/3a4447eb-2e98-47e2-ae6e-ae361ed39922-plugin-serving-cert") pod "kuadrant-console-plugin-85fd4b8b9d-jnf5d" (UID: "3a4447eb-2e98-47e2-ae6e-ae361ed39922") : secret "plugin-serving-cert" not found Jul 06 15:36:18.667991 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.667975 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/3a4447eb-2e98-47e2-ae6e-ae361ed39922-nginx-conf\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:18.686244 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:18.686218 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mt9q6\" (UniqueName: \"kubernetes.io/projected/3a4447eb-2e98-47e2-ae6e-ae361ed39922-kube-api-access-mt9q6\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:19.171496 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:19.171457 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4447eb-2e98-47e2-ae6e-ae361ed39922-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:19.173806 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:19.173781 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/3a4447eb-2e98-47e2-ae6e-ae361ed39922-plugin-serving-cert\") pod \"kuadrant-console-plugin-85fd4b8b9d-jnf5d\" (UID: \"3a4447eb-2e98-47e2-ae6e-ae361ed39922\") " pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:19.406630 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:19.406584 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" Jul 06 15:36:19.553739 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:19.553700 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d"] Jul 06 15:36:19.558128 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:36:19.558072 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a4447eb_2e98_47e2_ae6e_ae361ed39922.slice/crio-6b81de2f96577fc52c16f37bc9aadfe5891e98721aa35cc2c8e00b09920ac0ce WatchSource:0}: Error finding container 6b81de2f96577fc52c16f37bc9aadfe5891e98721aa35cc2c8e00b09920ac0ce: Status 404 returned error can't find the container with id 6b81de2f96577fc52c16f37bc9aadfe5891e98721aa35cc2c8e00b09920ac0ce Jul 06 15:36:20.004653 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:20.004615 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" event={"ID":"3a4447eb-2e98-47e2-ae6e-ae361ed39922","Type":"ContainerStarted","Data":"6b81de2f96577fc52c16f37bc9aadfe5891e98721aa35cc2c8e00b09920ac0ce"} Jul 06 15:36:20.956035 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:20.956001 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-6d85f6564-r8nc8" Jul 06 15:36:25.033008 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:25.032971 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" event={"ID":"3a4447eb-2e98-47e2-ae6e-ae361ed39922","Type":"ContainerStarted","Data":"ffe7f51812da5abc1f6e4a5ec5c140d3d9c8f056f2f3cc99e61a3a5a89feb1af"} Jul 06 15:36:25.081305 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:25.081257 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-85fd4b8b9d-jnf5d" podStartSLOduration=2.668825728 podStartE2EDuration="7.081236914s" totalImagesPullingTime="4.412411186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:36:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:36:25.078149404 +0000 UTC m=+644.336354878" watchObservedRunningTime="2026-07-06 15:36:25.081236914 +0000 UTC m=+644.339442393" Jul 06 15:36:26.990515 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:36:26.990487 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m" Jul 06 15:37:03.095510 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.095469 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:03.117358 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.117330 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:03.117554 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.117426 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.120242 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.120218 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 06 15:37:03.188429 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.188399 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:03.230203 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.230170 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fa6dadf-2105-44aa-8416-f1520a8a273c-config-file\") pod \"limitador-limitador-ff68ff5cb-9n7nl\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.230353 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.230262 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxn58\" (UniqueName: \"kubernetes.io/projected/9fa6dadf-2105-44aa-8416-f1520a8a273c-kube-api-access-wxn58\") pod \"limitador-limitador-ff68ff5cb-9n7nl\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.331232 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.331203 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fa6dadf-2105-44aa-8416-f1520a8a273c-config-file\") pod \"limitador-limitador-ff68ff5cb-9n7nl\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.331393 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.331253 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxn58\" (UniqueName: \"kubernetes.io/projected/9fa6dadf-2105-44aa-8416-f1520a8a273c-kube-api-access-wxn58\") pod \"limitador-limitador-ff68ff5cb-9n7nl\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.331802 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.331784 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fa6dadf-2105-44aa-8416-f1520a8a273c-config-file\") pod \"limitador-limitador-ff68ff5cb-9n7nl\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.341694 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.341673 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxn58\" (UniqueName: \"kubernetes.io/projected/9fa6dadf-2105-44aa-8416-f1520a8a273c-kube-api-access-wxn58\") pod \"limitador-limitador-ff68ff5cb-9n7nl\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.428446 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.428374 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:03.578590 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:03.578566 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:03.580685 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:37:03.580652 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa6dadf_2105_44aa_8416_f1520a8a273c.slice/crio-8eea8becadf6213b748177f8f845f5f22bca0ae03d2072cc009241d75aa8aa0e WatchSource:0}: Error finding container 8eea8becadf6213b748177f8f845f5f22bca0ae03d2072cc009241d75aa8aa0e: Status 404 returned error can't find the container with id 8eea8becadf6213b748177f8f845f5f22bca0ae03d2072cc009241d75aa8aa0e Jul 06 15:37:04.237394 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:04.237354 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" event={"ID":"9fa6dadf-2105-44aa-8416-f1520a8a273c","Type":"ContainerStarted","Data":"8eea8becadf6213b748177f8f845f5f22bca0ae03d2072cc009241d75aa8aa0e"} Jul 06 15:37:08.261430 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:08.261392 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" event={"ID":"9fa6dadf-2105-44aa-8416-f1520a8a273c","Type":"ContainerStarted","Data":"0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae"} Jul 06 15:37:08.261912 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:08.261533 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:08.282574 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:08.282531 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" podStartSLOduration=1.610221693 podStartE2EDuration="5.282518625s" totalImagesPullingTime="3.672296932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:37:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:37:08.279828705 +0000 UTC m=+687.538034176" watchObservedRunningTime="2026-07-06 15:37:08.282518625 +0000 UTC m=+687.540724142" Jul 06 15:37:19.267721 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:19.267692 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:20.030753 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.030714 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:20.031019 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.030988 2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" podUID="9fa6dadf-2105-44aa-8416-f1520a8a273c" containerName="limitador" containerID="cri-o://0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae" gracePeriod=30 Jul 06 15:37:20.578807 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.578785 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:20.667147 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.667053 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxn58\" (UniqueName: \"kubernetes.io/projected/9fa6dadf-2105-44aa-8416-f1520a8a273c-kube-api-access-wxn58\") pod \"9fa6dadf-2105-44aa-8416-f1520a8a273c\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " Jul 06 15:37:20.667147 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.667136 2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fa6dadf-2105-44aa-8416-f1520a8a273c-config-file\") pod \"9fa6dadf-2105-44aa-8416-f1520a8a273c\" (UID: \"9fa6dadf-2105-44aa-8416-f1520a8a273c\") " Jul 06 15:37:20.667500 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.667477 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa6dadf-2105-44aa-8416-f1520a8a273c-config-file" (OuterVolumeSpecName: "config-file") pod "9fa6dadf-2105-44aa-8416-f1520a8a273c" (UID: "9fa6dadf-2105-44aa-8416-f1520a8a273c"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 06 15:37:20.669229 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.669204 2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa6dadf-2105-44aa-8416-f1520a8a273c-kube-api-access-wxn58" (OuterVolumeSpecName: "kube-api-access-wxn58") pod "9fa6dadf-2105-44aa-8416-f1520a8a273c" (UID: "9fa6dadf-2105-44aa-8416-f1520a8a273c"). InnerVolumeSpecName "kube-api-access-wxn58". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 06 15:37:20.767902 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.767876 2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9fa6dadf-2105-44aa-8416-f1520a8a273c-config-file\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:37:20.767902 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:20.767897 2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxn58\" (UniqueName: \"kubernetes.io/projected/9fa6dadf-2105-44aa-8416-f1520a8a273c-kube-api-access-wxn58\") on node \"ip-10-0-134-39.ec2.internal\" DevicePath \"\"" Jul 06 15:37:21.326046 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.326016 2562 generic.go:356] "Generic (PLEG): container finished" podID="9fa6dadf-2105-44aa-8416-f1520a8a273c" containerID="0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae" exitCode=0 Jul 06 15:37:21.326193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.326059 2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" Jul 06 15:37:21.326193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.326109 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" event={"ID":"9fa6dadf-2105-44aa-8416-f1520a8a273c","Type":"ContainerDied","Data":"0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae"} Jul 06 15:37:21.326193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.326160 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl" event={"ID":"9fa6dadf-2105-44aa-8416-f1520a8a273c","Type":"ContainerDied","Data":"8eea8becadf6213b748177f8f845f5f22bca0ae03d2072cc009241d75aa8aa0e"} Jul 06 15:37:21.326193 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.326189 2562 scope.go:117] "RemoveContainer" containerID="0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae" Jul 06 15:37:21.334756 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.334741 2562 scope.go:117] "RemoveContainer" containerID="0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae" Jul 06 15:37:21.335019 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:37:21.335001 2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae\": container with ID starting with 0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae not found: ID does not exist" containerID="0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae" Jul 06 15:37:21.335107 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.335028 2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae"} err="failed to get container status \"0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae\": rpc error: code = NotFound desc = could not find container \"0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae\": container with ID starting with 0e14ba55e02ecf4893c1fa52c992daea88722f7730a4345a5155f440c8eed9ae not found: ID does not exist" Jul 06 15:37:21.346940 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.346915 2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:21.351974 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:21.351954 2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-ff68ff5cb-9n7nl"] Jul 06 15:37:23.257461 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:37:23.257428 2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa6dadf-2105-44aa-8416-f1520a8a273c" path="/var/lib/kubelet/pods/9fa6dadf-2105-44aa-8416-f1520a8a273c/volumes" Jul 06 15:38:10.277384 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.277346 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/model-serving-api-fd65d7d6-ww22q"] Jul 06 15:38:10.277882 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.277833 2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9fa6dadf-2105-44aa-8416-f1520a8a273c" containerName="limitador" Jul 06 15:38:10.277882 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.277855 2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9fa6dadf-2105-44aa-8416-f1520a8a273c" containerName="limitador" Jul 06 15:38:10.277991 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.277956 2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9fa6dadf-2105-44aa-8416-f1520a8a273c" containerName="limitador" Jul 06 15:38:10.280831 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.280811 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.283502 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.283482 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-tls\"" Jul 06 15:38:10.283613 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.283589 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"model-serving-api-dockercfg-pszfb\"" Jul 06 15:38:10.294070 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.294047 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ww22q"] Jul 06 15:38:10.303897 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.303866 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/odh-model-controller-84b54b7f97-m2wgk"] Jul 06 15:38:10.307179 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.307159 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.310390 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.310369 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-dockercfg-58fxf\"" Jul 06 15:38:10.310647 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.310631 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"odh-model-controller-webhook-cert\"" Jul 06 15:38:10.318684 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.318662 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-m2wgk"] Jul 06 15:38:10.371756 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.371724 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t64k2\" (UniqueName: \"kubernetes.io/projected/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-kube-api-access-t64k2\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.371915 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.371781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-tls-certs\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.472476 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.472446 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8dmb\" (UniqueName: \"kubernetes.io/projected/254c0938-e476-4579-ba94-42ae3486d5c0-kube-api-access-z8dmb\") pod \"odh-model-controller-84b54b7f97-m2wgk\" (UID: \"254c0938-e476-4579-ba94-42ae3486d5c0\") " pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.472476 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.472481 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-tls-certs\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.472663 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.472582 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t64k2\" (UniqueName: \"kubernetes.io/projected/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-kube-api-access-t64k2\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.472663 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.472638 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/254c0938-e476-4579-ba94-42ae3486d5c0-cert\") pod \"odh-model-controller-84b54b7f97-m2wgk\" (UID: \"254c0938-e476-4579-ba94-42ae3486d5c0\") " pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.472741 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:38:10.472591 2562 secret.go:189] Couldn't get secret kserve/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 06 15:38:10.472741 ip-10-0-134-39 kubenswrapper[2562]: E0706 15:38:10.472724 2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-tls-certs podName:b246c1d1-390f-42d4-ad9e-fcce3c50bacd nodeName:}" failed. No retries permitted until 2026-07-06 15:38:10.9727072 +0000 UTC m=+750.230912666 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-tls-certs") pod "model-serving-api-fd65d7d6-ww22q" (UID: "b246c1d1-390f-42d4-ad9e-fcce3c50bacd") : secret "model-serving-api-tls" not found Jul 06 15:38:10.484513 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.484488 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t64k2\" (UniqueName: \"kubernetes.io/projected/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-kube-api-access-t64k2\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.573285 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.573215 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/254c0938-e476-4579-ba94-42ae3486d5c0-cert\") pod \"odh-model-controller-84b54b7f97-m2wgk\" (UID: \"254c0938-e476-4579-ba94-42ae3486d5c0\") " pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.573285 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.573248 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8dmb\" (UniqueName: \"kubernetes.io/projected/254c0938-e476-4579-ba94-42ae3486d5c0-kube-api-access-z8dmb\") pod \"odh-model-controller-84b54b7f97-m2wgk\" (UID: \"254c0938-e476-4579-ba94-42ae3486d5c0\") " pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.575528 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.575507 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/254c0938-e476-4579-ba94-42ae3486d5c0-cert\") pod \"odh-model-controller-84b54b7f97-m2wgk\" (UID: \"254c0938-e476-4579-ba94-42ae3486d5c0\") " pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.586331 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.586306 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8dmb\" (UniqueName: \"kubernetes.io/projected/254c0938-e476-4579-ba94-42ae3486d5c0-kube-api-access-z8dmb\") pod \"odh-model-controller-84b54b7f97-m2wgk\" (UID: \"254c0938-e476-4579-ba94-42ae3486d5c0\") " pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.617991 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.617966 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:10.747502 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.747478 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/odh-model-controller-84b54b7f97-m2wgk"] Jul 06 15:38:10.749488 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:38:10.749461 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod254c0938_e476_4579_ba94_42ae3486d5c0.slice/crio-9dd7ca8e392e08d68027c31f66eb3ba8954660b5af2ab0d09b05f408d5c40da4 WatchSource:0}: Error finding container 9dd7ca8e392e08d68027c31f66eb3ba8954660b5af2ab0d09b05f408d5c40da4: Status 404 returned error can't find the container with id 9dd7ca8e392e08d68027c31f66eb3ba8954660b5af2ab0d09b05f408d5c40da4 Jul 06 15:38:10.750789 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.750772 2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 06 15:38:10.976044 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.975966 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-tls-certs\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:10.978324 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:10.978305 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b246c1d1-390f-42d4-ad9e-fcce3c50bacd-tls-certs\") pod \"model-serving-api-fd65d7d6-ww22q\" (UID: \"b246c1d1-390f-42d4-ad9e-fcce3c50bacd\") " pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:11.191710 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:11.191670 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:11.323834 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:11.323810 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/model-serving-api-fd65d7d6-ww22q"] Jul 06 15:38:11.325798 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:38:11.325776 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb246c1d1_390f_42d4_ad9e_fcce3c50bacd.slice/crio-95deaec32482c41734de7a2774411680050077d1791e43bc3352942905e537b0 WatchSource:0}: Error finding container 95deaec32482c41734de7a2774411680050077d1791e43bc3352942905e537b0: Status 404 returned error can't find the container with id 95deaec32482c41734de7a2774411680050077d1791e43bc3352942905e537b0 Jul 06 15:38:11.578382 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:11.578343 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ww22q" event={"ID":"b246c1d1-390f-42d4-ad9e-fcce3c50bacd","Type":"ContainerStarted","Data":"95deaec32482c41734de7a2774411680050077d1791e43bc3352942905e537b0"} Jul 06 15:38:11.579413 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:11.579389 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" event={"ID":"254c0938-e476-4579-ba94-42ae3486d5c0","Type":"ContainerStarted","Data":"9dd7ca8e392e08d68027c31f66eb3ba8954660b5af2ab0d09b05f408d5c40da4"} Jul 06 15:38:14.599280 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:14.599240 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/model-serving-api-fd65d7d6-ww22q" event={"ID":"b246c1d1-390f-42d4-ad9e-fcce3c50bacd","Type":"ContainerStarted","Data":"c8365a0ec9168d8b79dc205e9dadc4b9708b01721d12db688c9e8d39b08b988c"} Jul 06 15:38:14.599800 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:14.599365 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:38:14.600917 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:14.600893 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" event={"ID":"254c0938-e476-4579-ba94-42ae3486d5c0","Type":"ContainerStarted","Data":"e10f1a43aa3303843ee8bd4592f700667b720c5d9cbb1f8384dc8a5db3e32320"} Jul 06 15:38:14.601044 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:14.600988 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:14.621139 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:14.621062 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/model-serving-api-fd65d7d6-ww22q" podStartSLOduration=1.892029912 podStartE2EDuration="4.621043054s" totalImagesPullingTime="2.729013142s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:38:14.619309702 +0000 UTC m=+753.877515176" watchObservedRunningTime="2026-07-06 15:38:14.621043054 +0000 UTC m=+753.879248529" Jul 06 15:38:14.639990 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:14.639940 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" podStartSLOduration=1.331624485 podStartE2EDuration="4.63992511s" totalImagesPullingTime="3.308300625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:38:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:38:14.639363829 +0000 UTC m=+753.897569304" watchObservedRunningTime="2026-07-06 15:38:14.63992511 +0000 UTC m=+753.898130614" Jul 06 15:38:25.609106 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:25.609057 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/odh-model-controller-84b54b7f97-m2wgk" Jul 06 15:38:25.610807 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:38:25.610786 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/model-serving-api-fd65d7d6-ww22q" Jul 06 15:40:16.538146 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:16.538116 2562 ???:1] "http: TLS handshake error from 10.0.143.129:33018: EOF" Jul 06 15:40:16.560330 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:16.560308 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-grzgk_69a364e8-1295-4843-a063-177b9fde0416/discovery/0.log" Jul 06 15:40:16.678890 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:16.678866 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc4d6766f-c4lhm_206cc846-ccf8-4013-9dea-edf33f1e01aa/router/0.log" Jul 06 15:40:17.459881 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:17.459854 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-grzgk_69a364e8-1295-4843-a063-177b9fde0416/discovery/0.log" Jul 06 15:40:17.499660 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:17.499637 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc4d6766f-c4lhm_206cc846-ccf8-4013-9dea-edf33f1e01aa/router/0.log" Jul 06 15:40:18.234451 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:18.234424 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-r8nc8_e3510cae-18f8-433b-9dee-01cd6c4baef8/manager/0.log" Jul 06 15:40:18.251799 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:18.251777 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-n9wnv_943ca358-ca8b-438d-a7d2-5e85fb85e9b0/manager/0.log" Jul 06 15:40:18.275990 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:18.275968 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-jnf5d_3a4447eb-2e98-47e2-ae6e-ae361ed39922/kuadrant-console-plugin/0.log" Jul 06 15:40:18.310578 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:18.310554 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m_4b7f4b2b-98ad-4226-93da-424a85517b3f/manager/0.log" Jul 06 15:40:23.231871 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.231824 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2c9j/must-gather-pnw2d"] Jul 06 15:40:23.235296 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.235281 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.238550 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.238528 2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-p2c9j\"/\"default-dockercfg-hfqhq\"" Jul 06 15:40:23.238672 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.238563 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2c9j\"/\"kube-root-ca.crt\"" Jul 06 15:40:23.239593 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.239577 2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-p2c9j\"/\"openshift-service-ca.crt\"" Jul 06 15:40:23.246595 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.246575 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2c9j/must-gather-pnw2d"] Jul 06 15:40:23.338838 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.338812 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9hhq\" (UniqueName: \"kubernetes.io/projected/bb1fccd0-837e-47be-b937-ae7c9554d887-kube-api-access-r9hhq\") pod \"must-gather-pnw2d\" (UID: \"bb1fccd0-837e-47be-b937-ae7c9554d887\") " pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.339008 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.338866 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb1fccd0-837e-47be-b937-ae7c9554d887-must-gather-output\") pod \"must-gather-pnw2d\" (UID: \"bb1fccd0-837e-47be-b937-ae7c9554d887\") " pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.439371 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.439338 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb1fccd0-837e-47be-b937-ae7c9554d887-must-gather-output\") pod \"must-gather-pnw2d\" (UID: \"bb1fccd0-837e-47be-b937-ae7c9554d887\") " pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.439506 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.439399 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r9hhq\" (UniqueName: \"kubernetes.io/projected/bb1fccd0-837e-47be-b937-ae7c9554d887-kube-api-access-r9hhq\") pod \"must-gather-pnw2d\" (UID: \"bb1fccd0-837e-47be-b937-ae7c9554d887\") " pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.439769 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.439752 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/bb1fccd0-837e-47be-b937-ae7c9554d887-must-gather-output\") pod \"must-gather-pnw2d\" (UID: \"bb1fccd0-837e-47be-b937-ae7c9554d887\") " pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.450356 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.450327 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9hhq\" (UniqueName: \"kubernetes.io/projected/bb1fccd0-837e-47be-b937-ae7c9554d887-kube-api-access-r9hhq\") pod \"must-gather-pnw2d\" (UID: \"bb1fccd0-837e-47be-b937-ae7c9554d887\") " pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.544701 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.544668 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2c9j/must-gather-pnw2d" Jul 06 15:40:23.683124 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:23.683100 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2c9j/must-gather-pnw2d"] Jul 06 15:40:23.684605 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:40:23.684580 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb1fccd0_837e_47be_b937_ae7c9554d887.slice/crio-a6297cb87746930ced923423dd12d2c092c716d4325879e94ab4d4aa7152a3d8 WatchSource:0}: Error finding container a6297cb87746930ced923423dd12d2c092c716d4325879e94ab4d4aa7152a3d8: Status 404 returned error can't find the container with id a6297cb87746930ced923423dd12d2c092c716d4325879e94ab4d4aa7152a3d8 Jul 06 15:40:24.265877 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:24.265834 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/must-gather-pnw2d" event={"ID":"bb1fccd0-837e-47be-b937-ae7c9554d887","Type":"ContainerStarted","Data":"a6297cb87746930ced923423dd12d2c092c716d4325879e94ab4d4aa7152a3d8"} Jul 06 15:40:25.275697 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:25.275662 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/must-gather-pnw2d" event={"ID":"bb1fccd0-837e-47be-b937-ae7c9554d887","Type":"ContainerStarted","Data":"b98f738b1d91f41151fa972a93214f9a71feb810e226050e5b92d45ffb3991f7"} Jul 06 15:40:25.276205 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:25.275709 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/must-gather-pnw2d" event={"ID":"bb1fccd0-837e-47be-b937-ae7c9554d887","Type":"ContainerStarted","Data":"096da26f6b09feb219afbe3dafe960533cbff002bc6ce0a9bc75c3ee94b62e5b"} Jul 06 15:40:25.298525 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:25.298457 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2c9j/must-gather-pnw2d" podStartSLOduration=1.621278027 podStartE2EDuration="2.298437207s" totalImagesPullingTime="677.15918ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 15:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:40:25.298392282 +0000 UTC m=+884.556597757" watchObservedRunningTime="2026-07-06 15:40:25.298437207 +0000 UTC m=+884.556642682" Jul 06 15:40:26.351284 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:26.351250 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b682w_5ac4c2f1-72d9-4cf8-b4fc-be695679cef2/global-pull-secret-syncer/0.log" Jul 06 15:40:26.577540 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:26.577509 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bt6n5_11a9dbca-5f21-4226-85fb-922f1b89d741/konnectivity-agent/0.log" Jul 06 15:40:26.655720 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:26.655643 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-39.ec2.internal_487ce3ac867cb6a29534fc53f0fccb26/haproxy/0.log" Jul 06 15:40:30.730219 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:30.730126 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-6d85f6564-r8nc8_e3510cae-18f8-433b-9dee-01cd6c4baef8/manager/0.log" Jul 06 15:40:30.821974 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:30.821893 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-65b49595d7-n9wnv_943ca358-ca8b-438d-a7d2-5e85fb85e9b0/manager/0.log" Jul 06 15:40:30.892515 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:30.892488 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-85fd4b8b9d-jnf5d_3a4447eb-2e98-47e2-ae6e-ae361ed39922/kuadrant-console-plugin/0.log" Jul 06 15:40:30.995520 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:30.995401 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-bb7ddb7d7-rbk8m_4b7f4b2b-98ad-4226-93da-424a85517b3f/manager/0.log" Jul 06 15:40:33.249033 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:33.248946 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5466568bf7-6jhxm_0386a46f-e06b-4224-b149-ba586c27421e/metrics-server/0.log" Jul 06 15:40:33.329226 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:33.329195 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-7cftm_bcb51d9f-f249-4d41-af00-4d9ba9eda120/monitoring-plugin/0.log" Jul 06 15:40:33.750582 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:33.750549 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wpv6x_b19788b5-7ce4-47b0-95c7-e8854f6ca2f3/node-exporter/0.log" Jul 06 15:40:33.799554 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:33.799528 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wpv6x_b19788b5-7ce4-47b0-95c7-e8854f6ca2f3/kube-rbac-proxy/0.log" Jul 06 15:40:33.862138 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:33.862107 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wpv6x_b19788b5-7ce4-47b0-95c7-e8854f6ca2f3/init-textfile/0.log" Jul 06 15:40:34.545703 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.545665 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-skwt2_7cdd2d51-a129-4531-bd1c-6b957ffc1e1d/prometheus-operator/0.log" Jul 06 15:40:34.592757 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.592707 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-skwt2_7cdd2d51-a129-4531-bd1c-6b957ffc1e1d/kube-rbac-proxy/0.log" Jul 06 15:40:34.648761 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.648730 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-dksq5_9149a512-5a6c-4ddd-9a2e-b9bbe40a3a56/prometheus-operator-admission-webhook/0.log" Jul 06 15:40:34.869293 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.869213 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55748799f9-sxqh9_e3f23597-d2d9-4def-949e-d3a688fe90a6/thanos-query/0.log" Jul 06 15:40:34.913793 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.913752 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55748799f9-sxqh9_e3f23597-d2d9-4def-949e-d3a688fe90a6/kube-rbac-proxy-web/0.log" Jul 06 15:40:34.957360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.957333 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55748799f9-sxqh9_e3f23597-d2d9-4def-949e-d3a688fe90a6/kube-rbac-proxy/0.log" Jul 06 15:40:34.999982 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:34.999955 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55748799f9-sxqh9_e3f23597-d2d9-4def-949e-d3a688fe90a6/prom-label-proxy/0.log" Jul 06 15:40:35.041381 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.041349 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55748799f9-sxqh9_e3f23597-d2d9-4def-949e-d3a688fe90a6/kube-rbac-proxy-rules/0.log" Jul 06 15:40:35.077031 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.076956 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-55748799f9-sxqh9_e3f23597-d2d9-4def-949e-d3a688fe90a6/kube-rbac-proxy-metrics/0.log" Jul 06 15:40:35.895938 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.895905 2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb"] Jul 06 15:40:35.901162 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.901139 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:35.913053 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.913019 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb"] Jul 06 15:40:35.959717 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.959683 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-podres\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:35.959917 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.959748 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-sys\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:35.959917 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.959781 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w685x\" (UniqueName: \"kubernetes.io/projected/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-kube-api-access-w685x\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:35.959917 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.959855 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-proc\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:35.959917 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:35.959900 2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-lib-modules\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060392 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060348 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-podres\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060419 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-sys\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060451 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w685x\" (UniqueName: \"kubernetes.io/projected/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-kube-api-access-w685x\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060509 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-podres\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060516 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-proc\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060528 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-sys\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060569 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-proc\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060576 2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-lib-modules\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.060924 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.060759 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-lib-modules\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.073587 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.073551 2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w685x\" (UniqueName: \"kubernetes.io/projected/3ea4016a-742c-47dd-a3f0-c92eef29c6cb-kube-api-access-w685x\") pod \"perf-node-gather-daemonset-7wjzb\" (UID: \"3ea4016a-742c-47dd-a3f0-c92eef29c6cb\") " pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.215660 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.215579 2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:36.384495 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:36.384464 2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb"] Jul 06 15:40:36.387149 ip-10-0-134-39 kubenswrapper[2562]: W0706 15:40:36.387113 2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3ea4016a_742c_47dd_a3f0_c92eef29c6cb.slice/crio-8eb968c2545dd664ba4fe0ad58fec8f75394c42d06432a860c1fedf12c0a50ab WatchSource:0}: Error finding container 8eb968c2545dd664ba4fe0ad58fec8f75394c42d06432a860c1fedf12c0a50ab: Status 404 returned error can't find the container with id 8eb968c2545dd664ba4fe0ad58fec8f75394c42d06432a860c1fedf12c0a50ab Jul 06 15:40:37.367019 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:37.366981 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" event={"ID":"3ea4016a-742c-47dd-a3f0-c92eef29c6cb","Type":"ContainerStarted","Data":"783b73a5029028d887ca63c425255996880bca91808959e0492a9fc99b813439"} Jul 06 15:40:37.367395 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:37.367036 2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" event={"ID":"3ea4016a-742c-47dd-a3f0-c92eef29c6cb","Type":"ContainerStarted","Data":"8eb968c2545dd664ba4fe0ad58fec8f75394c42d06432a860c1fedf12c0a50ab"} Jul 06 15:40:37.367395 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:37.367110 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:37.389734 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:37.389673 2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" podStartSLOduration=2.38965412 podStartE2EDuration="2.38965412s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 15:40:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 15:40:37.387296211 +0000 UTC m=+896.645501687" watchObservedRunningTime="2026-07-06 15:40:37.38965412 +0000 UTC m=+896.647859594" Jul 06 15:40:38.049408 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:38.049372 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-5ftpf_39b39418-b74c-457c-a2cd-c8940ff75d8a/volume-data-source-validator/0.log" Jul 06 15:40:39.310632 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:39.310598 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qcqhg_a004ddc5-9026-4216-bc7b-57d612b66e0a/dns/0.log" Jul 06 15:40:39.351517 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:39.351478 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qcqhg_a004ddc5-9026-4216-bc7b-57d612b66e0a/kube-rbac-proxy/0.log" Jul 06 15:40:39.386445 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:39.386414 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6qttk_2a90e512-7b41-4d33-8937-a814ddb7b3a5/dns-node-resolver/0.log" Jul 06 15:40:40.139680 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:40.139647 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zsfkp_1e00f5ef-8cd2-44f0-8c2d-0ce60f5b086a/node-ca/0.log" Jul 06 15:40:41.271898 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:41.271867 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-grzgk_69a364e8-1295-4843-a063-177b9fde0416/discovery/0.log" Jul 06 15:40:41.340785 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:41.340760 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc4d6766f-c4lhm_206cc846-ccf8-4013-9dea-edf33f1e01aa/router/0.log" Jul 06 15:40:42.044632 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:42.044603 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xj6dc_9f14e1f4-7c54-4267-8025-daec13a60188/serve-healthcheck-canary/0.log" Jul 06 15:40:42.710063 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:42.710034 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vkll_73f4db36-bba8-40de-864b-028515b0e377/kube-rbac-proxy/0.log" Jul 06 15:40:42.747358 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:42.747332 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vkll_73f4db36-bba8-40de-864b-028515b0e377/exporter/0.log" Jul 06 15:40:42.796778 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:42.796750 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-6vkll_73f4db36-bba8-40de-864b-028515b0e377/extractor/0.log" Jul 06 15:40:43.387470 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:43.387440 2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-p2c9j/perf-node-gather-daemonset-7wjzb" Jul 06 15:40:46.409731 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:46.409700 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-fcf7k_34fa9d82-15aa-4c55-b789-d6211241f485/openshift-lws-operator/0.log" Jul 06 15:40:46.705512 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:46.705478 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-grzgk_69a364e8-1295-4843-a063-177b9fde0416/discovery/0.log" Jul 06 15:40:46.752851 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:46.752826 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc4d6766f-c4lhm_206cc846-ccf8-4013-9dea-edf33f1e01aa/router/0.log" Jul 06 15:40:47.168466 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:47.168414 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_llmisvc-controller-manager-74dff9949f-2g4pw_6a1468a4-d213-4e62-ab55-3410a7827c35/manager/0.log" Jul 06 15:40:47.209360 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:47.209329 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_model-serving-api-fd65d7d6-ww22q_b246c1d1-390f-42d4-ad9e-fcce3c50bacd/server/0.log" Jul 06 15:40:47.257773 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:47.257741 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_odh-model-controller-84b54b7f97-m2wgk_254c0938-e476-4579-ba94-42ae3486d5c0/manager/0.log" Jul 06 15:40:47.890218 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:47.890188 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-grzgk_69a364e8-1295-4843-a063-177b9fde0416/discovery/0.log" Jul 06 15:40:47.930355 ip-10-0-134-39 kubenswrapper[2562]: I0706 15:40:47.930311 2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7fc4d6766f-c4lhm_206cc846-ccf8-4013-9dea-edf33f1e01aa/router/0.log"