Jul 14 20:22:11.574778 ip-10-0-135-189 systemd[1]: Starting Kubernetes Kubelet... Jul 14 20:22:13.733264 ip-10-0-135-189 kubenswrapper[2566]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 20:22:13.733264 ip-10-0-135-189 kubenswrapper[2566]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 14 20:22:13.733264 ip-10-0-135-189 kubenswrapper[2566]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 20:22:13.733264 ip-10-0-135-189 kubenswrapper[2566]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 14 20:22:13.733264 ip-10-0-135-189 kubenswrapper[2566]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 14 20:22:13.733933 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.733326 2566 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 14 20:22:13.738546 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738525 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:13.738546 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738545 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:13.738546 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738550 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738553 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738557 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738560 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738563 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738566 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738569 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738571 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738575 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738578 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738581 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738599 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738603 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738605 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738608 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738613 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738617 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738619 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738622 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:13.738646 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738624 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738627 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738630 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738632 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738635 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738638 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738642 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738645 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738648 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738651 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738653 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738656 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738659 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738662 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738667 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738670 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738673 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738676 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738680 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:13.739125 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738683 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738686 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738689 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738692 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738695 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738697 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738700 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738702 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738705 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738708 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738710 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738713 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738716 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738718 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738722 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738726 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738731 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738734 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738737 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738740 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:13.739582 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738743 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738746 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738748 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738751 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738753 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738756 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738758 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738761 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738764 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738768 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738771 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738774 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738777 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738780 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738782 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738785 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738787 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738790 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738794 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738796 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:13.740085 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738799 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738801 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738804 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738807 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738809 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738812 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738815 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738817 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738820 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738822 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738825 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738828 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738831 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738834 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738836 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738839 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738842 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738844 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.738846 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739611 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739618 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:13.740540 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739621 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739624 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739627 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739629 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739633 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739636 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739639 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739641 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739644 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739647 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739650 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739652 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739655 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739658 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739662 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739666 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739669 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739672 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739674 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:13.741037 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739677 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739679 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739683 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739687 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739690 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739693 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739696 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739699 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739701 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739704 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739707 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739710 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739713 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739715 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739718 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739721 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739723 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739726 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739729 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:13.741528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739732 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739735 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739737 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739741 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739744 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739746 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739749 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739751 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739753 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739757 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739761 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739764 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739768 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739770 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739773 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739776 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739778 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739782 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739785 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:13.741991 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739787 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739790 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739793 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739796 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739798 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739801 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739803 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739806 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739808 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739811 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739813 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739816 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739818 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739822 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739824 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739827 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739831 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739834 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739836 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739838 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:13.742455 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739841 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739844 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739846 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739849 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739851 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739854 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739857 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739859 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739861 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739864 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739867 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739870 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739874 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739877 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739879 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739882 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739885 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739887 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739890 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.739892 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:13.742939 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740344 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740350 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740353 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740357 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740360 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740363 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740366 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740369 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740372 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740375 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740377 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740380 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740383 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740385 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740388 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740390 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740394 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740398 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740400 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740403 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:13.743451 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740406 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740408 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740411 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740414 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740417 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740419 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740422 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740424 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740427 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740430 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740432 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740436 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740439 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740442 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740444 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740447 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740450 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740452 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740457 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740460 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:13.744004 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740463 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740465 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740468 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740471 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740475 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740478 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740480 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740483 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740487 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740490 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740492 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740495 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740498 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740500 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740503 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740505 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740508 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740510 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740513 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:13.744483 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740516 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740518 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740520 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740523 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740525 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740528 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740530 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740533 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740535 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740537 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740540 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740543 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740546 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740550 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740553 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740555 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740558 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740560 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740563 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740565 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:13.744930 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740568 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740571 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740573 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740576 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740579 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740581 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740584 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740586 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740588 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740591 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740594 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740596 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740599 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740601 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740604 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740606 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740609 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740611 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740614 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.740616 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:13.745414 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740683 2566 flags.go:64] FLAG: --address="0.0.0.0" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740691 2566 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740698 2566 flags.go:64] FLAG: --anonymous-auth="true" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740703 2566 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740707 2566 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740724 2566 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740729 2566 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740734 2566 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740737 2566 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740740 2566 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740744 2566 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740747 2566 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740750 2566 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740754 2566 flags.go:64] FLAG: --cgroup-root="" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740757 2566 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740760 2566 flags.go:64] FLAG: --client-ca-file="" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740763 2566 flags.go:64] FLAG: --cloud-provider="external" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740766 2566 flags.go:64] FLAG: --cluster-dns="[]" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740770 2566 flags.go:64] FLAG: --cluster-domain="" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740773 2566 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740776 2566 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740779 2566 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740783 2566 flags.go:64] FLAG: --container-log-max-files="5" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740788 2566 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 14 20:22:13.745879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740791 2566 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740794 2566 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740798 2566 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740801 2566 flags.go:64] FLAG: --contention-profiling="false" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740804 2566 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740807 2566 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740810 2566 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740813 2566 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740817 2566 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740820 2566 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740823 2566 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740826 2566 flags.go:64] FLAG: --enable-load-reader="false" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740829 2566 flags.go:64] FLAG: --enable-server="true" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740832 2566 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740839 2566 flags.go:64] FLAG: --event-burst="100" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740842 2566 flags.go:64] FLAG: --event-qps="50" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740845 2566 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740848 2566 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740851 2566 flags.go:64] FLAG: --eviction-hard="" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740855 2566 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740858 2566 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740861 2566 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740864 2566 flags.go:64] FLAG: --eviction-soft="" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740867 2566 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740870 2566 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 14 20:22:13.746499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740873 2566 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740876 2566 flags.go:64] FLAG: --experimental-mounter-path="" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740879 2566 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740882 2566 flags.go:64] FLAG: --fail-swap-on="true" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740885 2566 flags.go:64] FLAG: --feature-gates="" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740889 2566 flags.go:64] FLAG: --file-check-frequency="20s" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740892 2566 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740896 2566 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740899 2566 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740902 2566 flags.go:64] FLAG: --healthz-port="10248" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740904 2566 flags.go:64] FLAG: --help="false" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740907 2566 flags.go:64] FLAG: --hostname-override="ip-10-0-135-189.ec2.internal" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740910 2566 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740913 2566 flags.go:64] FLAG: --http-check-frequency="20s" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740916 2566 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740919 2566 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740923 2566 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740926 2566 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740928 2566 flags.go:64] FLAG: --image-service-endpoint="" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740931 2566 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740934 2566 flags.go:64] FLAG: --kube-api-burst="100" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740938 2566 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740941 2566 flags.go:64] FLAG: --kube-api-qps="50" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740944 2566 flags.go:64] FLAG: --kube-reserved="" Jul 14 20:22:13.747136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740947 2566 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740950 2566 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740953 2566 flags.go:64] FLAG: --kubelet-cgroups="" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740970 2566 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740973 2566 flags.go:64] FLAG: --lock-file="" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740978 2566 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740981 2566 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740984 2566 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740990 2566 flags.go:64] FLAG: --log-json-split-stream="false" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740993 2566 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740996 2566 flags.go:64] FLAG: --log-text-split-stream="false" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.740999 2566 flags.go:64] FLAG: --logging-format="text" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741002 2566 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741005 2566 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741008 2566 flags.go:64] FLAG: --manifest-url="" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741012 2566 flags.go:64] FLAG: --manifest-url-header="" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741016 2566 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741019 2566 flags.go:64] FLAG: --max-open-files="1000000" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741023 2566 flags.go:64] FLAG: --max-pods="110" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741026 2566 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741029 2566 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741032 2566 flags.go:64] FLAG: --memory-manager-policy="None" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741035 2566 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741038 2566 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741041 2566 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 14 20:22:13.747725 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741044 2566 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741051 2566 flags.go:64] FLAG: --node-status-max-images="50" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741055 2566 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741060 2566 flags.go:64] FLAG: --oom-score-adj="-999" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741063 2566 flags.go:64] FLAG: --pod-cidr="" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741066 2566 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741072 2566 flags.go:64] FLAG: --pod-manifest-path="" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741075 2566 flags.go:64] FLAG: --pod-max-pids="-1" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741078 2566 flags.go:64] FLAG: --pods-per-core="0" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741081 2566 flags.go:64] FLAG: --port="10250" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741085 2566 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741088 2566 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0848180362bb2da79" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741092 2566 flags.go:64] FLAG: --qos-reserved="" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741095 2566 flags.go:64] FLAG: --read-only-port="10255" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741098 2566 flags.go:64] FLAG: --register-node="true" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741101 2566 flags.go:64] FLAG: --register-with-taints="" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741105 2566 flags.go:64] FLAG: --registry-burst="10" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741108 2566 flags.go:64] FLAG: --registry-qps="5" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741111 2566 flags.go:64] FLAG: --reserved-cpus="" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741114 2566 flags.go:64] FLAG: --reserved-memory="" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741118 2566 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741121 2566 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741124 2566 flags.go:64] FLAG: --rotate-certificates="false" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741127 2566 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741130 2566 flags.go:64] FLAG: --runonce="false" Jul 14 20:22:13.748465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741133 2566 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741136 2566 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741139 2566 flags.go:64] FLAG: --seccomp-default="false" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741142 2566 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741145 2566 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741148 2566 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741151 2566 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741154 2566 flags.go:64] FLAG: --storage-driver-password="root" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741157 2566 flags.go:64] FLAG: --storage-driver-secure="false" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741160 2566 flags.go:64] FLAG: --storage-driver-table="stats" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741163 2566 flags.go:64] FLAG: --storage-driver-user="root" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741167 2566 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741170 2566 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741173 2566 flags.go:64] FLAG: --system-cgroups="" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741176 2566 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741182 2566 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741185 2566 flags.go:64] FLAG: --tls-cert-file="" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741188 2566 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741192 2566 flags.go:64] FLAG: --tls-min-version="" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741196 2566 flags.go:64] FLAG: --tls-private-key-file="" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741199 2566 flags.go:64] FLAG: --topology-manager-policy="none" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741202 2566 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741205 2566 flags.go:64] FLAG: --topology-manager-scope="container" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741208 2566 flags.go:64] FLAG: --v="2" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741212 2566 flags.go:64] FLAG: --version="false" Jul 14 20:22:13.749119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741216 2566 flags.go:64] FLAG: --vmodule="" Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741220 2566 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.741223 2566 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741352 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741356 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741359 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741362 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741365 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741367 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741370 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741373 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741375 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741378 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741381 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741383 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741386 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741388 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741391 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741396 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741398 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:13.749899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741401 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741404 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741408 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741411 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741413 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741416 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741420 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741423 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741425 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741428 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741430 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741433 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741437 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741442 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741445 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741448 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741451 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741454 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741456 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:13.750680 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741459 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741461 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741464 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741467 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741469 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741472 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741474 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741477 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741479 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741482 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741484 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741488 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741491 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741493 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741496 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741499 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741502 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741504 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741507 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:13.751213 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741513 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741516 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741518 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741521 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741524 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741527 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741529 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741532 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741534 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741538 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741540 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741543 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741545 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741548 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741550 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741553 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741555 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741558 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741560 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:13.751674 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741563 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741566 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741570 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741573 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741575 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741579 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741582 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741585 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741587 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741590 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741592 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741596 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741598 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741602 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741604 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741607 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741610 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741612 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741615 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741617 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:13.752154 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741620 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741622 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741625 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741627 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.741630 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.742735 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.750623 2566 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.750649 2566 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.750790 2566 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.750990 2566 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751086 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751094 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751101 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751106 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751110 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:13.752627 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751115 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751119 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751123 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751127 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751132 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751137 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751140 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751144 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751148 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751153 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751157 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751161 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751165 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751169 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751173 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751177 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751181 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751185 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751189 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751193 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:13.753013 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751197 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751201 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751204 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751209 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751215 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751219 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751223 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751225 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751228 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751231 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751234 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751237 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751240 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751243 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751246 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751248 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751251 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751254 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751256 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751259 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:13.753484 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751261 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751264 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751266 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751269 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751271 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751274 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751276 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751279 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751282 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751285 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751288 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751290 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751292 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751295 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751297 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751300 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751303 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751306 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751309 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:13.754060 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751312 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751315 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751318 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751320 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751323 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751325 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751328 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751331 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751334 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751336 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751339 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751342 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751344 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751347 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751349 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751352 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751355 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751357 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751360 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751362 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:13.754517 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751367 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751372 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751376 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751380 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751384 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751387 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751390 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751393 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751396 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751398 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751401 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751405 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751408 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751410 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:13.755057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751413 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.751419 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751534 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751539 2566 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751542 2566 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751545 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751548 2566 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751551 2566 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751554 2566 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751557 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751559 2566 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751562 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751565 2566 feature_gate.go:328] unrecognized feature gate: Example Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751568 2566 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751578 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 14 20:22:13.755396 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751581 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751583 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751586 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751589 2566 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751592 2566 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751594 2566 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751597 2566 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751600 2566 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751602 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751605 2566 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751608 2566 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751611 2566 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751613 2566 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751616 2566 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751619 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751622 2566 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751625 2566 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751627 2566 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751630 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751633 2566 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 14 20:22:13.755808 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751636 2566 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751638 2566 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751641 2566 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751644 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751646 2566 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751649 2566 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751651 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751654 2566 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751656 2566 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751659 2566 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751661 2566 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751664 2566 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751672 2566 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751675 2566 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751678 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751680 2566 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751685 2566 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751688 2566 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751691 2566 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751694 2566 feature_gate.go:328] unrecognized feature gate: Example2 Jul 14 20:22:13.756413 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751697 2566 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751700 2566 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751702 2566 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751705 2566 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751707 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751710 2566 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751713 2566 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751716 2566 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751719 2566 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751721 2566 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751724 2566 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751727 2566 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751729 2566 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751732 2566 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751735 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751738 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751740 2566 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751743 2566 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751746 2566 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751748 2566 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 14 20:22:13.756899 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751751 2566 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751755 2566 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751758 2566 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751761 2566 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751764 2566 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751775 2566 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751778 2566 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751780 2566 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751783 2566 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751785 2566 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751788 2566 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751791 2566 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751793 2566 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751796 2566 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751798 2566 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751801 2566 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751803 2566 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751807 2566 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 14 20:22:13.757424 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751811 2566 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751815 2566 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751817 2566 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751820 2566 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751823 2566 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751826 2566 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751828 2566 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:13.751830 2566 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.751836 2566 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.751988 2566 server.go:962] "Client rotation is on, will bootstrap in background" Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.754601 2566 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.756072 2566 server.go:1019] "Starting client certificate rotation" Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.756191 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 20:22:13.758008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.756244 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 14 20:22:13.759287 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.759269 2566 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 20:22:13.760634 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.760606 2566 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 14 20:22:13.770479 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.770453 2566 log.go:25] "Validated CRI v1 runtime API" Jul 14 20:22:13.772548 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.772527 2566 log.go:25] "Validated CRI v1 image API" Jul 14 20:22:13.773854 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.773826 2566 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 14 20:22:13.778136 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.778113 2566 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ee22714b-145c-49b7-8317-3965740dbec9:/dev/nvme0n1p3 f12faaf6-4b0a-4b40-a2df-ad9844c1a8f6:/dev/nvme0n1p4] Jul 14 20:22:13.778224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.778135 2566 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 14 20:22:13.781003 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.780975 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 20:22:13.784175 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.784060 2566 manager.go:216] Machine: {Timestamp:2026-07-14 20:22:13.782234904 +0000 UTC m=+0.350350872 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3106153 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2fb058b6fc495e28e29dc805ed8cbc SystemUUID:ec2fb058-b6fc-495e-28e2-9dc805ed8cbc BootID:06d5f443-97fe-4188-a598-abe6b4d4716c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:67:6a:3b:a8:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:67:6a:3b:a8:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:72:16:22:be:ef:ac Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 14 20:22:13.784175 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.784168 2566 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 14 20:22:13.784332 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.784292 2566 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 14 20:22:13.786513 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.786483 2566 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 14 20:22:13.786668 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.786515 2566 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-189.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 14 20:22:13.787682 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.787671 2566 topology_manager.go:138] "Creating topology manager with none policy" Jul 14 20:22:13.787722 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.787684 2566 container_manager_linux.go:309] "Creating device plugin manager" Jul 14 20:22:13.787722 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.787692 2566 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 20:22:13.788473 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.788461 2566 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 14 20:22:13.789457 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.789446 2566 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 14 20:22:13.792023 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792011 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 14 20:22:13.792161 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792151 2566 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 14 20:22:13.792204 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792197 2566 kubelet.go:486] "Attempting to sync node with API server" Jul 14 20:22:13.792233 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792218 2566 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 14 20:22:13.792272 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792255 2566 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 14 20:22:13.792272 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792266 2566 kubelet.go:398] "Adding apiserver pod source" Jul 14 20:22:13.792348 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792276 2566 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 14 20:22:13.792741 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792724 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 20:22:13.792796 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.792752 2566 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 14 20:22:13.796696 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.796665 2566 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 14 20:22:13.798509 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798495 2566 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 14 20:22:13.798553 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798526 2566 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 14 20:22:13.798709 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798698 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 14 20:22:13.798749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798714 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 14 20:22:13.798749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798720 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 14 20:22:13.798749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798727 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 14 20:22:13.798749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798734 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 14 20:22:13.798749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.798740 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 14 20:22:13.799196 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.799186 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 14 20:22:13.799196 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.799196 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 14 20:22:13.799248 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.799203 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 14 20:22:13.799248 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.799209 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 14 20:22:13.799248 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.799218 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 14 20:22:13.799248 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.799225 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 14 20:22:13.800239 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.800228 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 14 20:22:13.800239 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.800239 2566 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 14 20:22:13.802604 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.802579 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 14 20:22:13.802604 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.802579 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 14 20:22:13.803943 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.803929 2566 server.go:1268] "Started kubelet" Jul 14 20:22:13.804097 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.804041 2566 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 14 20:22:13.804159 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.804123 2566 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 14 20:22:13.804540 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.804504 2566 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 14 20:22:13.804867 ip-10-0-135-189 systemd[1]: Started Kubernetes Kubelet. Jul 14 20:22:13.805417 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.805247 2566 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 14 20:22:13.806718 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.806704 2566 server.go:310] "Adding debug handlers to kubelet server" Jul 14 20:22:13.810193 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.810175 2566 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 14 20:22:13.810193 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.810187 2566 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 14 20:22:13.810336 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.810276 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:13.811175 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811159 2566 factory.go:55] Registering systemd factory Jul 14 20:22:13.811308 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811284 2566 factory.go:223] Registration of the systemd container factory successfully Jul 14 20:22:13.811574 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811560 2566 factory.go:153] Registering CRI-O factory Jul 14 20:22:13.811652 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811578 2566 factory.go:223] Registration of the crio container factory successfully Jul 14 20:22:13.811652 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811639 2566 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 14 20:22:13.811755 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811666 2566 factory.go:103] Registering Raw factory Jul 14 20:22:13.811755 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811685 2566 manager.go:1196] Started watching for new ooms in manager Jul 14 20:22:13.811844 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811809 2566 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 14 20:22:13.811844 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811821 2566 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 14 20:22:13.811944 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.811851 2566 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 14 20:22:13.811944 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.811935 2566 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 14 20:22:13.812084 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.812045 2566 reconstruct.go:97] "Volume reconstruction finished" Jul 14 20:22:13.812084 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.812054 2566 reconciler.go:29] "Reconciler: start to sync state" Jul 14 20:22:13.812177 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.812114 2566 manager.go:349] Starting recovery of all containers Jul 14 20:22:13.813450 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.813422 2566 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 14 20:22:13.813550 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.813516 2566 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-189.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 14 20:22:13.813633 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.813585 2566 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-189.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 14 20:22:13.815474 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.813613 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-189.ec2.internal.18c2419a672cd009 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-189.ec2.internal,UID:ip-10-0-135-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-189.ec2.internal,},FirstTimestamp:2026-07-14 20:22:13.803896841 +0000 UTC m=+0.372012809,LastTimestamp:2026-07-14 20:22:13.803896841 +0000 UTC m=+0.372012809,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-189.ec2.internal,}" Jul 14 20:22:13.823713 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.823683 2566 manager.go:354] Recovery completed Jul 14 20:22:13.825403 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.825305 2566 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 14 20:22:13.828623 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.828610 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:13.829413 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.829397 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbm2g" Jul 14 20:22:13.830433 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.830410 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:13.830517 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.830446 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:13.830517 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.830457 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:13.831004 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.830988 2566 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 14 20:22:13.831004 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.831002 2566 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 14 20:22:13.831107 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.831016 2566 state_mem.go:36] "Initialized new in-memory state store" Jul 14 20:22:13.831107 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.831052 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:13.831722 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.831706 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:13.831803 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.831731 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:13.831803 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.831742 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:13.832190 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.832175 2566 policy_none.go:49] "None policy: Start" Jul 14 20:22:13.832240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.832193 2566 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 14 20:22:13.832240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.832204 2566 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 14 20:22:13.832765 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.832671 2566 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-189.ec2.internal.18c2419a68c1b199 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-189.ec2.internal,UID:ip-10-0-135-189.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-189.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-189.ec2.internal,},FirstTimestamp:2026-07-14 20:22:13.830431129 +0000 UTC m=+0.398547096,LastTimestamp:2026-07-14 20:22:13.830431129 +0000 UTC m=+0.398547096,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-189.ec2.internal,}" Jul 14 20:22:13.833084 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.833072 2566 policy_none.go:47] "Start" Jul 14 20:22:13.834830 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.834815 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vbm2g" Jul 14 20:22:13.879557 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.879532 2566 manager.go:337] "Starting Device Plugin manager" Jul 14 20:22:13.879677 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.879568 2566 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 14 20:22:13.879677 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.879578 2566 server.go:87] "Starting device plugin registration server" Jul 14 20:22:13.879854 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.879839 2566 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 14 20:22:13.879906 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.879855 2566 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 14 20:22:13.879989 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.879932 2566 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 14 20:22:13.880051 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.880035 2566 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 14 20:22:13.880051 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.880048 2566 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 14 20:22:13.880623 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.880603 2566 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 14 20:22:13.880699 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.880656 2566 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:13.980508 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.980457 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:13.981768 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.981749 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:13.981845 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.981785 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:13.981845 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.981798 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:13.981845 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.981828 2566 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-189.ec2.internal" Jul 14 20:22:13.991973 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.991898 2566 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-189.ec2.internal" Jul 14 20:22:13.991973 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.991925 2566 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-189.ec2.internal\": node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:13.995404 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.995369 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 14 20:22:13.996735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.996714 2566 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 14 20:22:13.996832 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.996752 2566 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 14 20:22:13.996832 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.996772 2566 kubelet.go:2448] "Starting kubelet main sync loop" Jul 14 20:22:13.996832 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:13.996803 2566 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 14 20:22:13.999104 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:13.999083 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:14.017238 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.017218 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.097139 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.097084 2566 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal"] Jul 14 20:22:14.097328 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.097209 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:14.098317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.098296 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:14.098420 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.098332 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:14.098420 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.098345 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:14.099641 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.099624 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:14.099746 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.099731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.099794 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.099757 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:14.100453 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.100435 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:14.100538 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.100463 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:14.100538 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.100476 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:14.100538 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.100441 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:14.100538 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.100530 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:14.100538 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.100539 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:14.101628 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.101611 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.101673 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.101639 2566 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 14 20:22:14.102261 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.102242 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientMemory" Jul 14 20:22:14.102363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.102265 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasNoDiskPressure" Jul 14 20:22:14.102363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.102279 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeHasSufficientPID" Jul 14 20:22:14.113364 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.113337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5bf4ff53126132d5bbe9c941c3255d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal\" (UID: \"d5bf4ff53126132d5bbe9c941c3255d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.113461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.113365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5bf4ff53126132d5bbe9c941c3255d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal\" (UID: \"d5bf4ff53126132d5bbe9c941c3255d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.113461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.113382 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/26aa8f6b915985464c3fef79af344d3c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-189.ec2.internal\" (UID: \"26aa8f6b915985464c3fef79af344d3c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.117282 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.117264 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.125860 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.125832 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-189.ec2.internal\" not found" node="ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.130399 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.130381 2566 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-189.ec2.internal\" not found" node="ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.214522 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.214488 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/26aa8f6b915985464c3fef79af344d3c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-189.ec2.internal\" (UID: \"26aa8f6b915985464c3fef79af344d3c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.214667 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.214526 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5bf4ff53126132d5bbe9c941c3255d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal\" (UID: \"d5bf4ff53126132d5bbe9c941c3255d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.214667 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.214549 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5bf4ff53126132d5bbe9c941c3255d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal\" (UID: \"d5bf4ff53126132d5bbe9c941c3255d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.214667 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.214573 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/26aa8f6b915985464c3fef79af344d3c-config\") pod \"kube-apiserver-proxy-ip-10-0-135-189.ec2.internal\" (UID: \"26aa8f6b915985464c3fef79af344d3c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.214667 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.214586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d5bf4ff53126132d5bbe9c941c3255d3-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal\" (UID: \"d5bf4ff53126132d5bbe9c941c3255d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.214667 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.214582 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d5bf4ff53126132d5bbe9c941c3255d3-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal\" (UID: \"d5bf4ff53126132d5bbe9c941c3255d3\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.217579 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.217560 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.318506 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.318412 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.419090 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.419056 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.428244 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.428220 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.433247 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.433229 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" Jul 14 20:22:14.519872 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.519832 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.620477 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.620410 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.721098 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.721062 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.755248 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.755225 2566 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 14 20:22:14.755754 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.755356 2566 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 14 20:22:14.821436 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.821407 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.838204 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.838155 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-13 20:17:13 +0000 UTC" deadline="2028-01-19 09:47:07.609479418 +0000 UTC" Jul 14 20:22:14.838204 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.838197 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13285h24m52.771286413s" Jul 14 20:22:14.921947 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:14.921899 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:14.983691 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:14.983643 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bf4ff53126132d5bbe9c941c3255d3.slice/crio-15149ca14253b817b46d074a8097d5b4ce4571c05575528e62c7fc6a4ae13378 WatchSource:0}: Error finding container 15149ca14253b817b46d074a8097d5b4ce4571c05575528e62c7fc6a4ae13378: Status 404 returned error can't find the container with id 15149ca14253b817b46d074a8097d5b4ce4571c05575528e62c7fc6a4ae13378 Jul 14 20:22:14.984035 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:14.984012 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26aa8f6b915985464c3fef79af344d3c.slice/crio-e1c08dfb62e5c2c20064a336215c679e7052768ae9089c8c7ec023fab1b8ab1e WatchSource:0}: Error finding container e1c08dfb62e5c2c20064a336215c679e7052768ae9089c8c7ec023fab1b8ab1e: Status 404 returned error can't find the container with id e1c08dfb62e5c2c20064a336215c679e7052768ae9089c8c7ec023fab1b8ab1e Jul 14 20:22:14.989559 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.989541 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:22:14.999630 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:14.999592 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" event={"ID":"26aa8f6b915985464c3fef79af344d3c","Type":"ContainerStarted","Data":"e1c08dfb62e5c2c20064a336215c679e7052768ae9089c8c7ec023fab1b8ab1e"} Jul 14 20:22:15.000478 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.000458 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" event={"ID":"d5bf4ff53126132d5bbe9c941c3255d3","Type":"ContainerStarted","Data":"15149ca14253b817b46d074a8097d5b4ce4571c05575528e62c7fc6a4ae13378"} Jul 14 20:22:15.022535 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.022510 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:15.123220 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.123173 2566 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-189.ec2.internal\" not found" Jul 14 20:22:15.146804 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.146727 2566 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:15.211423 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.211391 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" Jul 14 20:22:15.223785 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.223761 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 20:22:15.225664 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.225645 2566 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" Jul 14 20:22:15.233596 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.233581 2566 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 14 20:22:15.237349 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.237325 2566 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:15.327759 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.327729 2566 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:15.587366 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.587337 2566 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 14 20:22:15.794545 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.794512 2566 apiserver.go:52] "Watching apiserver" Jul 14 20:22:15.802843 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.802813 2566 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 14 20:22:15.804271 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.804240 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-2gsg6","kube-system/konnectivity-agent-l4kgr","openshift-multus/multus-additional-cni-plugins-k2x4n","openshift-multus/network-metrics-daemon-r9mdm","openshift-network-diagnostics/network-check-target-v5qv8","openshift-network-operator/iptables-alerter-5bk87","openshift-ovn-kubernetes/ovnkube-node-jnqj5","kube-system/global-pull-secret-syncer-q97sn","kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt","openshift-cluster-node-tuning-operator/tuned-5f4rw","openshift-dns/node-resolver-946bq","openshift-image-registry/node-ca-mr9tb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal"] Jul 14 20:22:15.806235 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.806210 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.807404 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.807379 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.808548 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.808361 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.808950 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.809222 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.809498 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.809719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.809741 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.809836 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 14 20:22:15.810443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.809719 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.810801 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.810675 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.810801 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.810762 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-tcb2j\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.811095 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.811584 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.811831 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.811897 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.812256 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.812269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qmld8\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.812564 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.812821 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.813016 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.813201 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.813260 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.813623 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.814089 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ptfwh\"" Jul 14 20:22:15.814927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.814289 2566 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 14 20:22:15.815644 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.814997 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.815644 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.815072 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:15.816390 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.815950 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.817052 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.816789 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823096 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-twxlb\"" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823148 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823318 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823497 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823942 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823994 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 14 20:22:15.824205 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.823946 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dt9kg\"" Jul 14 20:22:15.824565 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.824272 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:15.824679 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.824632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:15.825286 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.825268 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.825568 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.825551 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.826101 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826080 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4gsc\" (UniqueName: \"kubernetes.io/projected/01c6eacb-abb9-4785-8b13-85d283cb56e9-kube-api-access-c4gsc\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.826165 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826122 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826212 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826153 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-ovn\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826270 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826209 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovnkube-config\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826270 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826249 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-os-release\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.826364 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826330 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-cni-bin\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826411 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826376 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:15.826466 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-kubelet\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826466 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826437 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-systemd-units\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826563 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826478 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-run-netns\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826563 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826508 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826563 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826540 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9vg\" (UniqueName: \"kubernetes.io/projected/355ba4c6-c56a-4ccf-a51c-8825b94a8525-kube-api-access-qm9vg\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826708 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826570 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-cni-netd\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826708 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826597 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-kubelet-config\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.826708 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826652 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01c6eacb-abb9-4785-8b13-85d283cb56e9-serviceca\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.826840 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826800 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr8lw\" (UniqueName: \"kubernetes.io/projected/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-kube-api-access-wr8lw\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.826893 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826883 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-var-lib-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.826943 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827010 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.826980 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827059 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827044 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827150 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827117 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:15.827214 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827147 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-node-log\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827214 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827184 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-cnibin\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827214 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827209 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 14 20:22:15.827351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827232 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.827351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827284 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-dbus\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.827351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827310 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-log-socket\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827340 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-system-cni-dir\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827371 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-iptables-alerter-script\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-slash\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827470 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7c8jc\"" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827486 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-etc-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827517 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-env-overrides\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827544 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovn-node-metrics-cert\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827576 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovnkube-script-lib\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827581 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kzwtc\"" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827622 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsbjj\" (UniqueName: \"kubernetes.io/projected/34345adb-3cba-4076-806a-0dcf148e23f2-kube-api-access-vsbjj\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827658 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01c6eacb-abb9-4785-8b13-85d283cb56e9-host\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827688 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-host-slash\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827730 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-systemd\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827763 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827798 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827852 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c49mj\" (UniqueName: \"kubernetes.io/projected/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-kube-api-access-c49mj\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:15.827898 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.827899 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hjbt2\"" Jul 14 20:22:15.828765 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.828743 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.828883 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.828866 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-d6g7v\"" Jul 14 20:22:15.828987 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.828971 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.829077 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.829063 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 14 20:22:15.829158 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.829144 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 14 20:22:15.829243 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.829229 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 14 20:22:15.830921 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.830902 2566 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 14 20:22:15.847071 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.847046 2566 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fnd86" Jul 14 20:22:15.857145 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.857125 2566 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fnd86" Jul 14 20:22:15.913715 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.913683 2566 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 14 20:22:15.929029 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.928985 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-run-netns\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.929217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929062 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9vg\" (UniqueName: \"kubernetes.io/projected/355ba4c6-c56a-4ccf-a51c-8825b94a8525-kube-api-access-qm9vg\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.929217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929094 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-run-netns\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.929217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929096 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.929217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929159 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-conf-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.929217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929188 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-cni-netd\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929223 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr8lw\" (UniqueName: \"kubernetes.io/projected/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-kube-api-access-wr8lw\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929248 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-system-cni-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929278 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-daemon-config\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929281 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929303 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn79c\" (UniqueName: \"kubernetes.io/projected/d27bc421-3505-4d69-883c-d4d0d5290e4f-kube-api-access-kn79c\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929328 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-hosts-file\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929345 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-cni-netd\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929353 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7gb7\" (UniqueName: \"kubernetes.io/projected/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-kube-api-access-k7gb7\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929386 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.929463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc6f13-4505-4774-b7bd-0890208dc0fe-konnectivity-ca\") pod \"konnectivity-agent-l4kgr\" (UID: \"bfbc6f13-4505-4774-b7bd-0890208dc0fe\") " pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929574 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9spdq\" (UniqueName: \"kubernetes.io/projected/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-kube-api-access-9spdq\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-node-log\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929627 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-cnibin\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929651 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929677 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-kubernetes\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929669 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-node-log\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-systemd\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929738 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-log-socket\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929761 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-socket-dir-parent\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929785 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfbc6f13-4505-4774-b7bd-0890208dc0fe-agent-certs\") pod \"konnectivity-agent-l4kgr\" (UID: \"bfbc6f13-4505-4774-b7bd-0890208dc0fe\") " pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929808 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-sys\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929836 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-etc-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929870 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-env-overrides\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929921 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovn-node-metrics-cert\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929952 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovnkube-script-lib\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929969 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-etc-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929996 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsbjj\" (UniqueName: \"kubernetes.io/projected/34345adb-3cba-4076-806a-0dcf148e23f2-kube-api-access-vsbjj\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysctl-conf\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930049 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-host-slash\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930072 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-k8s-cni-cncf-io\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930078 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930095 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930134 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysconfig\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysctl-d\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930182 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930208 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4gsc\" (UniqueName: \"kubernetes.io/projected/01c6eacb-abb9-4785-8b13-85d283cb56e9-kube-api-access-c4gsc\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930232 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930261 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-ovn\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.929811 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-log-socket\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-os-release\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930331 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-device-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930360 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-netns\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930365 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-os-release\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.930806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930432 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-cni-multus\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930463 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-hostroot\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-env-overrides\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930506 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-host-slash\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930494 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930561 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-ovn\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930595 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovnkube-script-lib\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930747 2566 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.930812 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930837 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-kubelet\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930863 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930900 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-run-ovn-kubernetes\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.930902 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:16.43086454 +0000 UTC m=+2.998980515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930914 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-kubelet\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930942 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.930995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-sys-fs\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.931601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931018 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-kubelet-config\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01c6eacb-abb9-4785-8b13-85d283cb56e9-serviceca\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931071 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-var-lib-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931096 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-modprobe-d\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931108 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-kubelet-config\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931119 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-var-lib-kubelet\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931159 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-var-lib-openvswitch\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931165 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-host\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931191 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931252 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d27bc421-3505-4d69-883c-d4d0d5290e4f-cni-binary-copy\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.931281 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-run\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931312 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-lib-modules\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.931335 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:22:16.431316332 +0000 UTC m=+2.999432299 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931378 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7385fcb-67c8-4498-817e-c920e806dbab-tmp\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931422 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-cnibin\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931448 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-multus-certs\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.932339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931454 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-cnibin\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931465 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-cni-binary-copy\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931472 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-registration-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931514 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931546 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-dbus\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931572 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-system-cni-dir\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931575 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931584 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/01c6eacb-abb9-4785-8b13-85d283cb56e9-serviceca\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-socket-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mwql\" (UniqueName: \"kubernetes.io/projected/c7385fcb-67c8-4498-817e-c920e806dbab-kube-api-access-6mwql\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-iptables-alerter-script\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931647 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/34345adb-3cba-4076-806a-0dcf148e23f2-system-cni-dir\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931662 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-slash\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931682 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-cni-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931702 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-cni-bin\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931707 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-dbus\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931720 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-etc-kubernetes\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.933142 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931748 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-slash\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931750 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01c6eacb-abb9-4785-8b13-85d283cb56e9-host\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931784 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/01c6eacb-abb9-4785-8b13-85d283cb56e9-host\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-systemd\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931850 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931860 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-run-systemd\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c49mj\" (UniqueName: \"kubernetes.io/projected/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-kube-api-access-c49mj\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931928 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-tmp-dir\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.931953 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7385fcb-67c8-4498-817e-c920e806dbab-etc-tuned\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932011 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovnkube-config\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-os-release\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932164 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-kubelet\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-cni-bin\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932239 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-host-cni-bin\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932242 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-systemd-units\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932284 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/355ba4c6-c56a-4ccf-a51c-8825b94a8525-systemd-units\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932358 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/34345adb-3cba-4076-806a-0dcf148e23f2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.933930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932485 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovnkube-config\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.934733 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.932786 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-iptables-alerter-script\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.935031 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.935010 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/355ba4c6-c56a-4ccf-a51c-8825b94a8525-ovn-node-metrics-cert\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.937715 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.937688 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr8lw\" (UniqueName: \"kubernetes.io/projected/fe3d99c6-61b3-4a2a-91fa-d7abd5d05841-kube-api-access-wr8lw\") pod \"iptables-alerter-5bk87\" (UID: \"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841\") " pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:15.938365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.938343 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9vg\" (UniqueName: \"kubernetes.io/projected/355ba4c6-c56a-4ccf-a51c-8825b94a8525-kube-api-access-qm9vg\") pod \"ovnkube-node-jnqj5\" (UID: \"355ba4c6-c56a-4ccf-a51c-8825b94a8525\") " pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:15.938594 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.938577 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:15.938661 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.938603 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:15.938661 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.938616 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:15.938769 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:15.938681 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:16.438666299 +0000 UTC m=+3.006782269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:15.941213 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.941172 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4gsc\" (UniqueName: \"kubernetes.io/projected/01c6eacb-abb9-4785-8b13-85d283cb56e9-kube-api-access-c4gsc\") pod \"node-ca-mr9tb\" (UID: \"01c6eacb-abb9-4785-8b13-85d283cb56e9\") " pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:15.941313 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.941265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsbjj\" (UniqueName: \"kubernetes.io/projected/34345adb-3cba-4076-806a-0dcf148e23f2-kube-api-access-vsbjj\") pod \"multus-additional-cni-plugins-k2x4n\" (UID: \"34345adb-3cba-4076-806a-0dcf148e23f2\") " pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:15.944399 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:15.944377 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c49mj\" (UniqueName: \"kubernetes.io/projected/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-kube-api-access-c49mj\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:16.032862 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.032818 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-hostroot\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.032890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-sys-fs\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.032908 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-hostroot\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.032920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-modprobe-d\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.032946 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-var-lib-kubelet\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.032984 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-host\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033016 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d27bc421-3505-4d69-883c-d4d0d5290e4f-cni-binary-copy\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033041 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-run\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033058 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-modprobe-d\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033104 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-run\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033111 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-host\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033111 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-var-lib-kubelet\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033129 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-lib-modules\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033177 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7385fcb-67c8-4498-817e-c920e806dbab-tmp\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033154 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-sys-fs\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033200 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-multus-certs\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033233 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-registration-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033239 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-multus-certs\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-socket-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mwql\" (UniqueName: \"kubernetes.io/projected/c7385fcb-67c8-4498-817e-c920e806dbab-kube-api-access-6mwql\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-cni-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033333 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-cni-bin\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-lib-modules\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.033363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033356 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-etc-kubernetes\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033405 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-etc-kubernetes\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033455 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-cni-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033493 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-cni-bin\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033535 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-registration-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033561 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-tmp-dir\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033585 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7385fcb-67c8-4498-817e-c920e806dbab-etc-tuned\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033609 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-os-release\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-kubelet\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033642 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d27bc421-3505-4d69-883c-d4d0d5290e4f-cni-binary-copy\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-conf-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-system-cni-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033691 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-os-release\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033634 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-socket-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033715 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-daemon-config\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033752 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn79c\" (UniqueName: \"kubernetes.io/projected/d27bc421-3505-4d69-883c-d4d0d5290e4f-kube-api-access-kn79c\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-hosts-file\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033804 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7gb7\" (UniqueName: \"kubernetes.io/projected/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-kube-api-access-k7gb7\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.034091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc6f13-4505-4774-b7bd-0890208dc0fe-konnectivity-ca\") pod \"konnectivity-agent-l4kgr\" (UID: \"bfbc6f13-4505-4774-b7bd-0890208dc0fe\") " pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033855 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9spdq\" (UniqueName: \"kubernetes.io/projected/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-kube-api-access-9spdq\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033881 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-cnibin\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033906 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033917 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-tmp-dir\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033930 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-kubernetes\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033970 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-systemd\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.033997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-socket-dir-parent\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034022 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfbc6f13-4505-4774-b7bd-0890208dc0fe-agent-certs\") pod \"konnectivity-agent-l4kgr\" (UID: \"bfbc6f13-4505-4774-b7bd-0890208dc0fe\") " pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034044 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-sys\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysctl-conf\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-k8s-cni-cncf-io\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034126 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034147 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-daemon-config\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034212 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysconfig\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034220 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-cnibin\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034262 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-conf-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034334 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.034907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034356 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-kubelet\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034390 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-kubernetes\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034440 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-systemd\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034466 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bfbc6f13-4505-4774-b7bd-0890208dc0fe-konnectivity-ca\") pod \"konnectivity-agent-l4kgr\" (UID: \"bfbc6f13-4505-4774-b7bd-0890208dc0fe\") " pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034492 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-hosts-file\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034498 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-system-cni-dir\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034503 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-multus-socket-dir-parent\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034150 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysconfig\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034540 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysctl-d\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034552 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-k8s-cni-cncf-io\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034601 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034619 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-device-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034650 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-netns\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034656 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-sys\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034623 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysctl-conf\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034679 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-cni-multus\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034687 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-device-dir\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034697 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-run-netns\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.035735 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034731 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c7385fcb-67c8-4498-817e-c920e806dbab-etc-sysctl-d\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.036357 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.034741 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d27bc421-3505-4d69-883c-d4d0d5290e4f-host-var-lib-cni-multus\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.036357 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.035830 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7385fcb-67c8-4498-817e-c920e806dbab-tmp\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.036357 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.035999 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c7385fcb-67c8-4498-817e-c920e806dbab-etc-tuned\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.036769 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.036749 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bfbc6f13-4505-4774-b7bd-0890208dc0fe-agent-certs\") pod \"konnectivity-agent-l4kgr\" (UID: \"bfbc6f13-4505-4774-b7bd-0890208dc0fe\") " pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:16.042192 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.042169 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mwql\" (UniqueName: \"kubernetes.io/projected/c7385fcb-67c8-4498-817e-c920e806dbab-kube-api-access-6mwql\") pod \"tuned-5f4rw\" (UID: \"c7385fcb-67c8-4498-817e-c920e806dbab\") " pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.044842 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.044823 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7gb7\" (UniqueName: \"kubernetes.io/projected/9dafb0b0-ceaa-478c-888e-14bf94c8eb00-kube-api-access-k7gb7\") pod \"node-resolver-946bq\" (UID: \"9dafb0b0-ceaa-478c-888e-14bf94c8eb00\") " pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.045217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.045193 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn79c\" (UniqueName: \"kubernetes.io/projected/d27bc421-3505-4d69-883c-d4d0d5290e4f-kube-api-access-kn79c\") pod \"multus-2gsg6\" (UID: \"d27bc421-3505-4d69-883c-d4d0d5290e4f\") " pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.045335 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.045321 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9spdq\" (UniqueName: \"kubernetes.io/projected/8ec89483-011f-43bf-b2e5-1fb0ef64f6f0-kube-api-access-9spdq\") pod \"aws-ebs-csi-driver-node-6nbxt\" (UID: \"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.131434 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.131358 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:16.138331 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.138305 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mr9tb" Jul 14 20:22:16.148832 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.148806 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" Jul 14 20:22:16.155668 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.155645 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5bk87" Jul 14 20:22:16.163215 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.163193 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2gsg6" Jul 14 20:22:16.172083 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.172062 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" Jul 14 20:22:16.186659 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.186632 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" Jul 14 20:22:16.192393 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.192369 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:16.198946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.198918 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-946bq" Jul 14 20:22:16.436845 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.436753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:16.437027 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.436917 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:16.437027 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.436929 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:16.437136 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.437035 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:22:17.437013734 +0000 UTC m=+4.005129713 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:16.437136 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.437075 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:16.437244 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.437136 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:17.437117487 +0000 UTC m=+4.005233447 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:16.537822 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.537780 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:16.538015 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.537985 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:16.538015 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.538016 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:16.538200 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.538029 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:16.538200 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.538098 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:17.538078276 +0000 UTC m=+4.106194231 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:16.794850 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.794821 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01c6eacb_abb9_4785_8b13_85d283cb56e9.slice/crio-77b1a5f2da498af37eb9f3b464a882d32c6d2ee0d6c135759f724f9dce4f0e13 WatchSource:0}: Error finding container 77b1a5f2da498af37eb9f3b464a882d32c6d2ee0d6c135759f724f9dce4f0e13: Status 404 returned error can't find the container with id 77b1a5f2da498af37eb9f3b464a882d32c6d2ee0d6c135759f724f9dce4f0e13 Jul 14 20:22:16.796901 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.796818 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe3d99c6_61b3_4a2a_91fa_d7abd5d05841.slice/crio-9f3628aa275858e8765d04a7626a3a0d7873a09cb86d0a11e3f34975c9fb2b34 WatchSource:0}: Error finding container 9f3628aa275858e8765d04a7626a3a0d7873a09cb86d0a11e3f34975c9fb2b34: Status 404 returned error can't find the container with id 9f3628aa275858e8765d04a7626a3a0d7873a09cb86d0a11e3f34975c9fb2b34 Jul 14 20:22:16.797234 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.797204 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ec89483_011f_43bf_b2e5_1fb0ef64f6f0.slice/crio-d8ca78882abb12fe2f9007e5d9930db83340c8933e8311f923c542d596dab1e6 WatchSource:0}: Error finding container d8ca78882abb12fe2f9007e5d9930db83340c8933e8311f923c542d596dab1e6: Status 404 returned error can't find the container with id d8ca78882abb12fe2f9007e5d9930db83340c8933e8311f923c542d596dab1e6 Jul 14 20:22:16.798423 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.798398 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dafb0b0_ceaa_478c_888e_14bf94c8eb00.slice/crio-f873473d85d44ac80eddef9ee46a2656edacdae3046378838d54ba180f13ad8e WatchSource:0}: Error finding container f873473d85d44ac80eddef9ee46a2656edacdae3046378838d54ba180f13ad8e: Status 404 returned error can't find the container with id f873473d85d44ac80eddef9ee46a2656edacdae3046378838d54ba180f13ad8e Jul 14 20:22:16.801891 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.801872 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod355ba4c6_c56a_4ccf_a51c_8825b94a8525.slice/crio-fb27b661801f21c918f88a3d18afbfc783924a8c3879e456c97576b4eb79496e WatchSource:0}: Error finding container fb27b661801f21c918f88a3d18afbfc783924a8c3879e456c97576b4eb79496e: Status 404 returned error can't find the container with id fb27b661801f21c918f88a3d18afbfc783924a8c3879e456c97576b4eb79496e Jul 14 20:22:16.803178 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.803156 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34345adb_3cba_4076_806a_0dcf148e23f2.slice/crio-7204a4aa40f71093b13c3b2697206762bea89e091910bd59ff473e3322589881 WatchSource:0}: Error finding container 7204a4aa40f71093b13c3b2697206762bea89e091910bd59ff473e3322589881: Status 404 returned error can't find the container with id 7204a4aa40f71093b13c3b2697206762bea89e091910bd59ff473e3322589881 Jul 14 20:22:16.804187 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.804100 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfbc6f13_4505_4774_b7bd_0890208dc0fe.slice/crio-3a601c79f000e83ebbbea5298cff97cac369b1cfcfebe0bf2c72a6b41b630f52 WatchSource:0}: Error finding container 3a601c79f000e83ebbbea5298cff97cac369b1cfcfebe0bf2c72a6b41b630f52: Status 404 returned error can't find the container with id 3a601c79f000e83ebbbea5298cff97cac369b1cfcfebe0bf2c72a6b41b630f52 Jul 14 20:22:16.805138 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.805117 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd27bc421_3505_4d69_883c_d4d0d5290e4f.slice/crio-9195ad58fa4f8ed864ccb7b9b70c9bd7dad509838e832e23856aee8012df4846 WatchSource:0}: Error finding container 9195ad58fa4f8ed864ccb7b9b70c9bd7dad509838e832e23856aee8012df4846: Status 404 returned error can't find the container with id 9195ad58fa4f8ed864ccb7b9b70c9bd7dad509838e832e23856aee8012df4846 Jul 14 20:22:16.806591 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:16.806480 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7385fcb_67c8_4498_817e_c920e806dbab.slice/crio-6468c117d8d5e07f3ad47edb9f9caf662a18133a8345620ed5ea7317fc70227c WatchSource:0}: Error finding container 6468c117d8d5e07f3ad47edb9f9caf662a18133a8345620ed5ea7317fc70227c: Status 404 returned error can't find the container with id 6468c117d8d5e07f3ad47edb9f9caf662a18133a8345620ed5ea7317fc70227c Jul 14 20:22:16.859943 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.859767 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 20:17:15 +0000 UTC" deadline="2028-01-30 21:29:53.07770964 +0000 UTC" Jul 14 20:22:16.859943 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.859942 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13561h7m36.217773257s" Jul 14 20:22:16.997145 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:16.997118 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:16.997282 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:16.997261 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:17.006847 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.006812 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gsg6" event={"ID":"d27bc421-3505-4d69-883c-d4d0d5290e4f","Type":"ContainerStarted","Data":"9195ad58fa4f8ed864ccb7b9b70c9bd7dad509838e832e23856aee8012df4846"} Jul 14 20:22:17.007840 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.007816 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l4kgr" event={"ID":"bfbc6f13-4505-4774-b7bd-0890208dc0fe","Type":"ContainerStarted","Data":"3a601c79f000e83ebbbea5298cff97cac369b1cfcfebe0bf2c72a6b41b630f52"} Jul 14 20:22:17.008926 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.008903 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerStarted","Data":"7204a4aa40f71093b13c3b2697206762bea89e091910bd59ff473e3322589881"} Jul 14 20:22:17.010005 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.009982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-946bq" event={"ID":"9dafb0b0-ceaa-478c-888e-14bf94c8eb00","Type":"ContainerStarted","Data":"f873473d85d44ac80eddef9ee46a2656edacdae3046378838d54ba180f13ad8e"} Jul 14 20:22:17.011032 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.011009 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bk87" event={"ID":"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841","Type":"ContainerStarted","Data":"9f3628aa275858e8765d04a7626a3a0d7873a09cb86d0a11e3f34975c9fb2b34"} Jul 14 20:22:17.012848 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.012826 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" event={"ID":"26aa8f6b915985464c3fef79af344d3c","Type":"ContainerStarted","Data":"8128f4a794e8be7fb2468cb4766ba679581bf1a1f4fcfc72ac56c2aba3462b64"} Jul 14 20:22:17.014083 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.014062 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"fb27b661801f21c918f88a3d18afbfc783924a8c3879e456c97576b4eb79496e"} Jul 14 20:22:17.015128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.015109 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" event={"ID":"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0","Type":"ContainerStarted","Data":"d8ca78882abb12fe2f9007e5d9930db83340c8933e8311f923c542d596dab1e6"} Jul 14 20:22:17.017170 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.017145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mr9tb" event={"ID":"01c6eacb-abb9-4785-8b13-85d283cb56e9","Type":"ContainerStarted","Data":"77b1a5f2da498af37eb9f3b464a882d32c6d2ee0d6c135759f724f9dce4f0e13"} Jul 14 20:22:17.019336 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.019316 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" event={"ID":"d5bf4ff53126132d5bbe9c941c3255d3","Type":"ContainerStarted","Data":"35207564009cd09528248d2b785dbd2c1ba544cd9ba693712104c481923fbde9"} Jul 14 20:22:17.020415 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.020394 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" event={"ID":"c7385fcb-67c8-4498-817e-c920e806dbab","Type":"ContainerStarted","Data":"6468c117d8d5e07f3ad47edb9f9caf662a18133a8345620ed5ea7317fc70227c"} Jul 14 20:22:17.030146 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.030025 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-189.ec2.internal" podStartSLOduration=2.030011029 podStartE2EDuration="2.030011029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:17.029500276 +0000 UTC m=+3.597616252" watchObservedRunningTime="2026-07-14 20:22:17.030011029 +0000 UTC m=+3.598127002" Jul 14 20:22:17.446839 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.446798 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:17.447040 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.446876 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:17.447101 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.447074 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:17.447173 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.447140 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:22:19.44711956 +0000 UTC m=+6.015235518 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:17.447558 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.447537 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:17.447619 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.447597 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:19.447582 +0000 UTC m=+6.015697957 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:17.548327 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.548287 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:17.548519 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.548493 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:17.548519 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.548518 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:17.548654 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.548531 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:17.548654 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:17.548589 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:19.548572642 +0000 UTC m=+6.116688609 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:17.860693 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.860588 2566 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-13 20:17:15 +0000 UTC" deadline="2028-04-12 04:55:20.36996902 +0000 UTC" Jul 14 20:22:17.860693 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:17.860658 2566 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15296h33m2.509315182s" Jul 14 20:22:18.006499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:18.006386 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:18.006706 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:18.006504 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:18.007283 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:18.006896 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:18.007283 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:18.007062 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:18.050179 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:18.050137 2566 generic.go:356] "Generic (PLEG): container finished" podID="d5bf4ff53126132d5bbe9c941c3255d3" containerID="35207564009cd09528248d2b785dbd2c1ba544cd9ba693712104c481923fbde9" exitCode=0 Jul 14 20:22:18.051106 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:18.050769 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" event={"ID":"d5bf4ff53126132d5bbe9c941c3255d3","Type":"ContainerDied","Data":"35207564009cd09528248d2b785dbd2c1ba544cd9ba693712104c481923fbde9"} Jul 14 20:22:18.997836 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:18.997801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:18.998328 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:18.997945 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:19.084482 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:19.084442 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" event={"ID":"d5bf4ff53126132d5bbe9c941c3255d3","Type":"ContainerStarted","Data":"33bc57b103a92ef01488f125904539efd6f79f8fee3609787649658759b15758"} Jul 14 20:22:19.465497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:19.464735 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:19.465497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:19.464807 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:19.465497 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.464930 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:19.465497 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.465006 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:22:23.464987626 +0000 UTC m=+10.033103586 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:19.465497 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.465410 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:19.465497 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.465459 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:23.465444137 +0000 UTC m=+10.033560096 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:19.566165 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:19.565507 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:19.566165 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.565668 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:19.566165 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.565690 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:19.566165 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.565702 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:19.566165 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.565758 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:23.565741693 +0000 UTC m=+10.133857651 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:19.998977 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:19.998439 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:19.998977 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.998586 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:19.998977 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:19.998949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:19.999538 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:19.999070 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:20.997900 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:20.997406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:20.997900 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:20.997549 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:21.997765 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:21.997672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:21.998192 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:21.997830 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:21.998192 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:21.998017 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:21.998192 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:21.998124 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:22.997119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:22.997082 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:22.997306 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:22.997226 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:23.501042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:23.500972 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:23.501523 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:23.501050 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:23.501523 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.501138 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:23.501523 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.501204 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:22:31.501184541 +0000 UTC m=+18.069300513 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:23.501523 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.501138 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:23.501523 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.501320 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:31.501304576 +0000 UTC m=+18.069420534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:23.601443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:23.601407 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:23.601628 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.601571 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:23.601628 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.601590 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:23.601628 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.601601 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:23.601782 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.601662 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:31.601644515 +0000 UTC m=+18.169760470 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:23.998792 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:23.998753 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:23.998993 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.998872 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:23.999111 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:23.999063 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:23.999224 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:23.999175 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:24.998019 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:24.997727 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:24.998019 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:24.997869 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:25.997257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:25.997219 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:25.997456 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:25.997370 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:25.997456 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:25.997219 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:25.997564 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:25.997502 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:26.997382 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:26.997345 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:26.997860 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:26.997472 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:27.997558 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:27.997459 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:27.997558 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:27.997497 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:27.998039 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:27.997620 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:27.998039 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:27.997751 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:28.997598 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:28.997566 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:28.998036 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:28.997686 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:29.997969 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:29.997819 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:29.998432 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:29.997986 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:29.998432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:29.998031 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:29.998432 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:29.998154 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:30.997937 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:30.997895 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:30.998143 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:30.998041 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:31.563815 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:31.563773 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:31.564028 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:31.563834 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:31.564028 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.563939 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:31.564028 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.563942 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:31.564028 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.564029 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:47.564011789 +0000 UTC m=+34.132127763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:31.564250 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.564052 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:22:47.56404047 +0000 UTC m=+34.132156425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:31.664195 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:31.664149 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:31.664398 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.664323 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:31.664398 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.664350 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:31.664398 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.664364 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:31.664547 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.664435 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:47.66441703 +0000 UTC m=+34.232532985 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:31.998102 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:31.998017 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:31.998102 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:31.998052 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:31.998640 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.998149 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:31.998640 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:31.998257 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:32.997195 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:32.997157 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:32.997378 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:32.997279 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:34.000462 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:34.000434 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:34.000867 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:34.000443 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:34.000867 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:34.000531 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:34.000867 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:34.000630 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:34.997501 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:34.997462 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:34.997684 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:34.997593 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:35.997416 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:35.997229 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:35.997917 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:35.997500 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:35.997917 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:35.997874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:35.998025 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:35.997942 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:36.120420 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.120390 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" event={"ID":"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0","Type":"ContainerStarted","Data":"06ebfb6427f5e388a3c5af044f488e8d8df02294107e512ca149774685019d44"} Jul 14 20:22:36.122167 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.122134 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mr9tb" event={"ID":"01c6eacb-abb9-4785-8b13-85d283cb56e9","Type":"ContainerStarted","Data":"500e4b4d87acdbb6d1fb0aa3661bc673a121506ac153816450a49511000d1067"} Jul 14 20:22:36.124220 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.124189 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" event={"ID":"c7385fcb-67c8-4498-817e-c920e806dbab","Type":"ContainerStarted","Data":"c15b8935d5a0f1aa8aa16cd92fe34ce84cce5b0198bcc7c6f31c86ea9746e950"} Jul 14 20:22:36.125749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.125726 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l4kgr" event={"ID":"bfbc6f13-4505-4774-b7bd-0890208dc0fe","Type":"ContainerStarted","Data":"1740c44d1dff025b8edd1a29b5a17a8277bd40352e8027a95e4098dbb23435fd"} Jul 14 20:22:36.127210 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.127184 2566 generic.go:356] "Generic (PLEG): container finished" podID="34345adb-3cba-4076-806a-0dcf148e23f2" containerID="bd15a36bb3c42b7974e626d01afc02cb150ef4222ecdddd08fe6778dd527e8e6" exitCode=0 Jul 14 20:22:36.127292 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.127257 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerDied","Data":"bd15a36bb3c42b7974e626d01afc02cb150ef4222ecdddd08fe6778dd527e8e6"} Jul 14 20:22:36.128687 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.128666 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-946bq" event={"ID":"9dafb0b0-ceaa-478c-888e-14bf94c8eb00","Type":"ContainerStarted","Data":"ae11b5e48d8114fd22246dab532583a1d22f7533335a451794e73da2cbdd78a8"} Jul 14 20:22:36.130224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.130199 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:22:36.130592 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.130568 2566 generic.go:356] "Generic (PLEG): container finished" podID="355ba4c6-c56a-4ccf-a51c-8825b94a8525" containerID="91ede5c52e24469050f13a9217bda47c4a05f5acd0a6626f905051a6b5d4b018" exitCode=1 Jul 14 20:22:36.130654 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.130607 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerDied","Data":"91ede5c52e24469050f13a9217bda47c4a05f5acd0a6626f905051a6b5d4b018"} Jul 14 20:22:36.130729 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.130672 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"b014667ad7e32d3bf70251f555530d978ba341d753d359f5c7a7af885a91c80f"} Jul 14 20:22:36.135989 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.135923 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mr9tb" podStartSLOduration=7.731573073 podStartE2EDuration="22.135908005s" totalImagesPullingTime="14.404334932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:36.135734798 +0000 UTC m=+22.703850775" watchObservedRunningTime="2026-07-14 20:22:36.135908005 +0000 UTC m=+22.704023983" Jul 14 20:22:36.136078 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.136042 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-189.ec2.internal" podStartSLOduration=21.13603171 podStartE2EDuration="21.13603171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:19.103234782 +0000 UTC m=+5.671350761" watchObservedRunningTime="2026-07-14 20:22:36.13603171 +0000 UTC m=+22.704147689" Jul 14 20:22:36.174885 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.174841 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l4kgr" podStartSLOduration=3.233283302 podStartE2EDuration="22.17482732s" totalImagesPullingTime="18.941544018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:36.174385196 +0000 UTC m=+22.742501172" watchObservedRunningTime="2026-07-14 20:22:36.17482732 +0000 UTC m=+22.742943305" Jul 14 20:22:36.192541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.192494 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5f4rw" podStartSLOduration=3.251446003 podStartE2EDuration="22.192479344s" totalImagesPullingTime="18.941033341s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:36.192374729 +0000 UTC m=+22.760490699" watchObservedRunningTime="2026-07-14 20:22:36.192479344 +0000 UTC m=+22.760595321" Jul 14 20:22:36.206022 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.205953 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-946bq" podStartSLOduration=3.258468489 podStartE2EDuration="22.205938211s" totalImagesPullingTime="18.947469722s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:36.205615318 +0000 UTC m=+22.773731301" watchObservedRunningTime="2026-07-14 20:22:36.205938211 +0000 UTC m=+22.774054187" Jul 14 20:22:36.997610 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:36.997358 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:36.998046 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:36.997715 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:37.068744 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.068713 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:37.069414 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.069396 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:37.135159 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.135132 2566 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 14 20:22:37.136601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.136577 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:22:37.137083 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.137058 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"577cc8da2543673d0bef21ac6dd475608b14407cbee756bac70a0a0961f1c9a3"} Jul 14 20:22:37.137169 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.137127 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"de456ae6545c156bbfb0c3a169139316f04e16e13512e88a7f1c370a8cc7c651"} Jul 14 20:22:37.137229 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.137173 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"5bc5e64af50da9cf7ea5a82ffb47f56160fa5a4053bcfd9259d3daf1273d4306"} Jul 14 20:22:37.137229 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.137205 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"e1bf5d1c285319b97c238b0faf299bbdc8ab23d38f997bfeb0e9167dfabac4a8"} Jul 14 20:22:37.139014 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.138986 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" event={"ID":"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0","Type":"ContainerStarted","Data":"16f3828bde8bae852afd0819c4ec01c6b2092aa7b415a0bdfef1f0d7a88fbc0f"} Jul 14 20:22:37.141058 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.141021 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2gsg6" event={"ID":"d27bc421-3505-4d69-883c-d4d0d5290e4f","Type":"ContainerStarted","Data":"1c38ea1e462b63f90d9ea165c51d6264a80cb9554d516f721700679a177299de"} Jul 14 20:22:37.141470 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.141448 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:37.141703 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.141680 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l4kgr" Jul 14 20:22:37.894261 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.894122 2566 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-14T20:22:37.135154447Z","UUID":"6a494694-b230-4810-a707-7f74e50e4b6c","Handler":null,"Name":"","Endpoint":""} Jul 14 20:22:37.895930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.895907 2566 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 14 20:22:37.896089 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.895950 2566 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 14 20:22:37.997463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.997414 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:37.997463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:37.997458 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:37.998123 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:37.997560 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:37.998123 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:37.997692 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:38.144880 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:38.144789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5bk87" event={"ID":"fe3d99c6-61b3-4a2a-91fa-d7abd5d05841","Type":"ContainerStarted","Data":"6b5917183f49f4f0cd053716c4cdf930676a6131e0ae5247e4a769810080972b"} Jul 14 20:22:38.164131 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:38.164072 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5bk87" podStartSLOduration=5.215425657 podStartE2EDuration="24.164051419s" totalImagesPullingTime="18.948625762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:38.16385442 +0000 UTC m=+24.731970401" watchObservedRunningTime="2026-07-14 20:22:38.164051419 +0000 UTC m=+24.732167397" Jul 14 20:22:38.164639 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:38.164601 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2gsg6" podStartSLOduration=4.834376319 podStartE2EDuration="24.164592661s" totalImagesPullingTime="19.330216342s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:37.190266903 +0000 UTC m=+23.758382889" watchObservedRunningTime="2026-07-14 20:22:38.164592661 +0000 UTC m=+24.732708633" Jul 14 20:22:38.998135 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:38.997906 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:38.998621 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:38.998225 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:39.150463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:39.150431 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:22:39.150924 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:39.150876 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"2e5791a3142978a50a1b13396a2022a226d686e69b30ec01df37defa9f23dc45"} Jul 14 20:22:39.153147 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:39.153111 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" event={"ID":"8ec89483-011f-43bf-b2e5-1fb0ef64f6f0","Type":"ContainerStarted","Data":"00637da8ee3ca200a9438a8071519fc37060b4fe35e4731d0bf088a89c373716"} Jul 14 20:22:39.170568 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:39.170525 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6nbxt" podStartSLOduration=3.9496940560000002 podStartE2EDuration="25.170510945s" totalImagesPullingTime="21.220816889s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:39.169987827 +0000 UTC m=+25.738103804" watchObservedRunningTime="2026-07-14 20:22:39.170510945 +0000 UTC m=+25.738626922" Jul 14 20:22:39.997704 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:39.997674 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:39.997895 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:39.997673 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:39.997895 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:39.997811 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:39.997895 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:39.997880 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:40.998239 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:40.997947 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:40.999045 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:40.998258 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:41.160646 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.160616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:22:41.161058 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.161033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"684bac5f28a4762f5dfe895d97fc72c5de5e70eb939376fa59922b3c794f41b9"} Jul 14 20:22:41.161286 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.161264 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:41.161565 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.161535 2566 scope.go:117] "RemoveContainer" containerID="91ede5c52e24469050f13a9217bda47c4a05f5acd0a6626f905051a6b5d4b018" Jul 14 20:22:41.163130 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.163106 2566 generic.go:356] "Generic (PLEG): container finished" podID="34345adb-3cba-4076-806a-0dcf148e23f2" containerID="c2c9c1a621ff8b9d9a66694911f743d308d7e8f9fa46e7ea25ca2e1b0a8af183" exitCode=0 Jul 14 20:22:41.163212 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.163145 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerDied","Data":"c2c9c1a621ff8b9d9a66694911f743d308d7e8f9fa46e7ea25ca2e1b0a8af183"} Jul 14 20:22:41.178855 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.178835 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:41.997918 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.997882 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:41.998125 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:41.997923 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:41.998125 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:41.998059 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:41.998237 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:41.998162 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:42.169338 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.169314 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:22:42.169806 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.169647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" event={"ID":"355ba4c6-c56a-4ccf-a51c-8825b94a8525","Type":"ContainerStarted","Data":"71c4b1f5c8cecc3122f8a1d4ab4a273664e16bb87ea3999eaedfc017a6c23d11"} Jul 14 20:22:42.169944 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.169923 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:42.170042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.170023 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:42.184639 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.184615 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:22:42.197060 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.197011 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" podStartSLOduration=9.204853228 podStartE2EDuration="28.196995756s" totalImagesPullingTime="18.992142528s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:42.19656233 +0000 UTC m=+28.764678320" watchObservedRunningTime="2026-07-14 20:22:42.196995756 +0000 UTC m=+28.765111732" Jul 14 20:22:42.799204 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.799172 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q97sn"] Jul 14 20:22:42.799391 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.799349 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:42.799483 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:42.799460 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:42.802148 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.802125 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v5qv8"] Jul 14 20:22:42.802269 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.802207 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:42.802328 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:42.802276 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:42.805079 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.805057 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r9mdm"] Jul 14 20:22:42.805194 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:42.805154 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:42.805283 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:42.805261 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:43.174752 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:43.174519 2566 generic.go:356] "Generic (PLEG): container finished" podID="34345adb-3cba-4076-806a-0dcf148e23f2" containerID="86783df3eff19a69e11a2f092a2793f4f2def12fef04b725ab9384f4ef83b9c1" exitCode=0 Jul 14 20:22:43.175112 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:43.174564 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerDied","Data":"86783df3eff19a69e11a2f092a2793f4f2def12fef04b725ab9384f4ef83b9c1"} Jul 14 20:22:44.998112 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:44.998028 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:44.998463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:44.998028 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:44.998463 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:44.998138 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:44.998463 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:44.998028 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:44.998463 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:44.998219 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:44.998463 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:44.998281 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:45.185385 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:45.185353 2566 generic.go:356] "Generic (PLEG): container finished" podID="34345adb-3cba-4076-806a-0dcf148e23f2" containerID="f43025bf10c91552e2aff9278f9b3cdcee7ab4d1a7bd5e9409d1aa7adcb01735" exitCode=0 Jul 14 20:22:45.185529 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:45.185396 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerDied","Data":"f43025bf10c91552e2aff9278f9b3cdcee7ab4d1a7bd5e9409d1aa7adcb01735"} Jul 14 20:22:46.997895 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:46.997858 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:46.998721 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:46.997859 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:46.998721 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:46.998016 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:22:46.998721 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:46.997858 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:46.998721 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:46.998069 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-v5qv8" podUID="2ef12939-a949-42ed-9226-2b89594022c0" Jul 14 20:22:46.998721 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:46.998140 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-q97sn" podUID="27a6cb5c-dfe0-4f10-b8b1-7f58739f0776" Jul 14 20:22:47.580270 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:47.580226 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:47.580474 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:47.580310 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:47.580474 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.580406 2566 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:47.580474 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.580433 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:47.580637 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.580497 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:23:19.580476216 +0000 UTC m=+66.148592175 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 14 20:22:47.580637 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.580515 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret podName:27a6cb5c-dfe0-4f10-b8b1-7f58739f0776 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:19.580508844 +0000 UTC m=+66.148624798 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret") pod "global-pull-secret-syncer-q97sn" (UID: "27a6cb5c-dfe0-4f10-b8b1-7f58739f0776") : object "kube-system"/"original-pull-secret" not registered Jul 14 20:22:47.681185 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:47.681099 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:47.681336 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.681283 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 14 20:22:47.681336 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.681306 2566 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 14 20:22:47.681336 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.681317 2566 projected.go:196] Error preparing data for projected volume kube-api-access-smcdv for pod openshift-network-diagnostics/network-check-target-v5qv8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:47.681436 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:47.681390 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv podName:2ef12939-a949-42ed-9226-2b89594022c0 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:19.681368103 +0000 UTC m=+66.249484061 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-smcdv" (UniqueName: "kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv") pod "network-check-target-v5qv8" (UID: "2ef12939-a949-42ed-9226-2b89594022c0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 14 20:22:48.813052 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.813013 2566 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-189.ec2.internal" event="NodeReady" Jul 14 20:22:48.813556 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.813179 2566 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 14 20:22:48.846993 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.846943 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fd69b8c94-x4p6t"] Jul 14 20:22:48.872931 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.872879 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n8snf"] Jul 14 20:22:48.873119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.873039 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.875343 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.875311 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 14 20:22:48.875343 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.875322 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xn5rs\"" Jul 14 20:22:48.875547 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.875326 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 14 20:22:48.875998 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.875947 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 14 20:22:48.880444 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.880424 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 14 20:22:48.888925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.888894 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7kz89"] Jul 14 20:22:48.889066 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.889049 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:48.891504 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.891482 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qv2tt\"" Jul 14 20:22:48.891644 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.891503 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 14 20:22:48.892406 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.892355 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 14 20:22:48.907312 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.907287 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd69b8c94-x4p6t"] Jul 14 20:22:48.907468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.907328 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7kz89"] Jul 14 20:22:48.907468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.907426 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:48.907468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.907456 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8snf"] Jul 14 20:22:48.909711 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.909695 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 14 20:22:48.909830 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.909745 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 14 20:22:48.909830 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.909792 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 14 20:22:48.910236 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.910220 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-plh4p\"" Jul 14 20:22:48.990523 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990480 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-registry-certificates\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.990523 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990524 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js9d5\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-kube-api-access-js9d5\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.990757 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:48.990757 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990594 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dsnr\" (UniqueName: \"kubernetes.io/projected/84644784-a141-4dda-b4e1-089ed1b2e26b-kube-api-access-2dsnr\") pod \"ingress-canary-7kz89\" (UID: \"84644784-a141-4dda-b4e1-089ed1b2e26b\") " pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:48.990757 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990617 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.990757 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990699 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-image-registry-private-configuration\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.990757 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990741 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-trusted-ca\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.991011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990762 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-bound-sa-token\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.991011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990790 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7lfn\" (UniqueName: \"kubernetes.io/projected/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-kube-api-access-d7lfn\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:48.991011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990850 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-config-volume\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:48.991011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990888 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84644784-a141-4dda-b4e1-089ed1b2e26b-cert\") pod \"ingress-canary-7kz89\" (UID: \"84644784-a141-4dda-b4e1-089ed1b2e26b\") " pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:48.991011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990920 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b08d123b-73d4-4176-81d7-7672a46c2907-ca-trust-extracted\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.991011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.990944 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-tmp-dir\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:48.991257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.991040 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-installation-pull-secrets\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:48.997550 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.997524 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:22:48.997692 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.997562 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:22:48.997692 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.997525 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:22:49.000109 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:48.999873 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 20:22:49.000109 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.000090 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rw2b\"" Jul 14 20:22:49.000322 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.000152 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hghx\"" Jul 14 20:22:49.000322 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.000168 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 20:22:49.000322 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.000303 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 20:22:49.000484 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.000394 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 20:22:49.092327 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84644784-a141-4dda-b4e1-089ed1b2e26b-cert\") pod \"ingress-canary-7kz89\" (UID: \"84644784-a141-4dda-b4e1-089ed1b2e26b\") " pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:49.092327 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092283 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b08d123b-73d4-4176-81d7-7672a46c2907-ca-trust-extracted\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092327 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092311 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-tmp-dir\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.092594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092335 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-installation-pull-secrets\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092398 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-registry-certificates\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092551 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js9d5\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-kube-api-access-js9d5\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092611 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.092734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092641 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dsnr\" (UniqueName: \"kubernetes.io/projected/84644784-a141-4dda-b4e1-089ed1b2e26b-kube-api-access-2dsnr\") pod \"ingress-canary-7kz89\" (UID: \"84644784-a141-4dda-b4e1-089ed1b2e26b\") " pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:49.092734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092690 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092697 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-tmp-dir\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092732 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-image-registry-private-configuration\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092756 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-trusted-ca\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-bound-sa-token\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092801 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7lfn\" (UniqueName: \"kubernetes.io/projected/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-kube-api-access-d7lfn\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092825 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-config-volume\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.092837 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.092733 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b08d123b-73d4-4176-81d7-7672a46c2907-ca-trust-extracted\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.092915 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.092910 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:49.592890076 +0000 UTC m=+36.161006036 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:22:49.093426 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.093047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-registry-certificates\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.093426 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.093131 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:22:49.093426 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.093147 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:22:49.093426 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.093191 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:49.593176101 +0000 UTC m=+36.161292078 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:22:49.093426 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.093366 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-config-volume\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.094293 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.094083 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-trusted-ca\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.097427 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.097397 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-image-registry-private-configuration\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.097558 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.097525 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-installation-pull-secrets\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.097619 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.097582 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/84644784-a141-4dda-b4e1-089ed1b2e26b-cert\") pod \"ingress-canary-7kz89\" (UID: \"84644784-a141-4dda-b4e1-089ed1b2e26b\") " pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:49.101034 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.101011 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7lfn\" (UniqueName: \"kubernetes.io/projected/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-kube-api-access-d7lfn\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.101146 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.101047 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dsnr\" (UniqueName: \"kubernetes.io/projected/84644784-a141-4dda-b4e1-089ed1b2e26b-kube-api-access-2dsnr\") pod \"ingress-canary-7kz89\" (UID: \"84644784-a141-4dda-b4e1-089ed1b2e26b\") " pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:49.101204 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.101179 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-bound-sa-token\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.112123 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.112096 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js9d5\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-kube-api-access-js9d5\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.218910 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.218874 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7kz89" Jul 14 20:22:49.596649 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.596606 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:49.596787 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.596675 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:49.596787 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.596762 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:49.596907 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.596840 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:22:49.596907 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.596860 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:22:49.596907 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.596845 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:50.596828201 +0000 UTC m=+37.164944160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:22:49.597043 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:49.596925 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:50.596906238 +0000 UTC m=+37.165022198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:22:49.748904 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:49.748867 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7kz89"] Jul 14 20:22:49.826147 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:22:49.826114 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84644784_a141_4dda_b4e1_089ed1b2e26b.slice/crio-47ee805695bbfb6744d28aa637a0ec9b330ed7c148d3c00b70ea681f07a6d081 WatchSource:0}: Error finding container 47ee805695bbfb6744d28aa637a0ec9b330ed7c148d3c00b70ea681f07a6d081: Status 404 returned error can't find the container with id 47ee805695bbfb6744d28aa637a0ec9b330ed7c148d3c00b70ea681f07a6d081 Jul 14 20:22:50.200024 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:50.199903 2566 generic.go:356] "Generic (PLEG): container finished" podID="34345adb-3cba-4076-806a-0dcf148e23f2" containerID="2aefbd30636aec71402a789dbd6a5f488fbdcb18161c60262ea373fc1a791b06" exitCode=0 Jul 14 20:22:50.200024 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:50.199993 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerDied","Data":"2aefbd30636aec71402a789dbd6a5f488fbdcb18161c60262ea373fc1a791b06"} Jul 14 20:22:50.201188 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:50.201166 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7kz89" event={"ID":"84644784-a141-4dda-b4e1-089ed1b2e26b","Type":"ContainerStarted","Data":"47ee805695bbfb6744d28aa637a0ec9b330ed7c148d3c00b70ea681f07a6d081"} Jul 14 20:22:50.604949 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:50.604912 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:50.605140 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:50.604980 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:50.605140 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:50.605069 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:50.605140 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:50.605081 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:22:50.605140 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:50.605135 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:52.6051187 +0000 UTC m=+39.173234654 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:22:50.605275 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:50.605135 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:22:50.605275 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:50.605187 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:52.605180422 +0000 UTC m=+39.173296378 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:22:51.209699 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:51.209466 2566 generic.go:356] "Generic (PLEG): container finished" podID="34345adb-3cba-4076-806a-0dcf148e23f2" containerID="bc1accdadf90704c0a0ebcf7a966aba704097a27e94ab23fe36ee666c0c74632" exitCode=0 Jul 14 20:22:51.210167 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:51.209559 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerDied","Data":"bc1accdadf90704c0a0ebcf7a966aba704097a27e94ab23fe36ee666c0c74632"} Jul 14 20:22:52.215713 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:52.215680 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" event={"ID":"34345adb-3cba-4076-806a-0dcf148e23f2","Type":"ContainerStarted","Data":"e332a4b9d44c692dda96404057a22b7a35fd0243d2ff9e863535cf54eb6960c7"} Jul 14 20:22:52.237260 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:52.237200 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-k2x4n" podStartSLOduration=8.203968411 podStartE2EDuration="38.237177638s" totalImagesPullingTime="30.033209227s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:52.236090625 +0000 UTC m=+38.804206604" watchObservedRunningTime="2026-07-14 20:22:52.237177638 +0000 UTC m=+38.805293619" Jul 14 20:22:52.621608 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:52.621496 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:52.621665 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:52.621620 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:22:52.621665 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:52.621634 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:22:52.621753 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:52.621677 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:56.621662089 +0000 UTC m=+43.189778044 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:22:52.621753 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:52.621620 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:52.621753 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:52.621700 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:52.621851 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:52.621754 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:22:56.621739759 +0000 UTC m=+43.189855747 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:22:53.219470 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:53.219430 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7kz89" event={"ID":"84644784-a141-4dda-b4e1-089ed1b2e26b","Type":"ContainerStarted","Data":"97faf58ad6a2f508a7486edad2f8faf9b7bf0b86816babf8f1b552550cc9a62c"} Jul 14 20:22:53.234164 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:53.234113 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7kz89" podStartSLOduration=2.447436946 podStartE2EDuration="5.23409688s" totalImagesPullingTime="2.786659934s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:22:53.23391045 +0000 UTC m=+39.802026427" watchObservedRunningTime="2026-07-14 20:22:53.23409688 +0000 UTC m=+39.802212835" Jul 14 20:22:56.651570 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:56.651523 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:22:56.652074 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:56.651703 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:22:56.652074 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:56.651731 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:22:56.652074 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:22:56.651734 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:22:56.652074 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:56.651802 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:04.651781467 +0000 UTC m=+51.219897444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:22:56.652074 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:56.651842 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:22:56.652074 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:22:56.651888 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:04.65187353 +0000 UTC m=+51.219989485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:23:04.713744 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:04.713705 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:23:04.714284 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:04.713758 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:23:04.714284 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:04.713854 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:04.714284 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:04.713911 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:23:04.714284 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:04.713924 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:20.713906236 +0000 UTC m=+67.282022195 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:23:04.714284 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:04.713926 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:23:04.714284 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:04.714012 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:20.713994712 +0000 UTC m=+67.282110687 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:23:14.190172 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:14.190139 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jnqj5" Jul 14 20:23:19.620822 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.620781 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:23:19.621357 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.620854 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:23:19.623033 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.623015 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 14 20:23:19.623108 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.623092 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 14 20:23:19.631810 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:19.631781 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 20:23:19.631886 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:19.631863 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:24:23.631842029 +0000 UTC m=+130.199957985 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : secret "metrics-daemon-secret" not found Jul 14 20:23:19.635289 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.635264 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/27a6cb5c-dfe0-4f10-b8b1-7f58739f0776-original-pull-secret\") pod \"global-pull-secret-syncer-q97sn\" (UID: \"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776\") " pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:23:19.721689 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.721658 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:23:19.724056 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.724038 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 14 20:23:19.734087 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.734070 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 14 20:23:19.745928 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.745894 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smcdv\" (UniqueName: \"kubernetes.io/projected/2ef12939-a949-42ed-9226-2b89594022c0-kube-api-access-smcdv\") pod \"network-check-target-v5qv8\" (UID: \"2ef12939-a949-42ed-9226-2b89594022c0\") " pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:23:19.918188 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.918100 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-q97sn" Jul 14 20:23:19.926721 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.926700 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rw2b\"" Jul 14 20:23:19.935373 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:19.935349 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:23:20.060014 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:20.059928 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-q97sn"] Jul 14 20:23:20.064734 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:23:20.064692 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a6cb5c_dfe0_4f10_b8b1_7f58739f0776.slice/crio-e2efb2d57dc3dd7e1d88d6d8b58693afc7178637fe6dcc8fe62e8dbe60fd8958 WatchSource:0}: Error finding container e2efb2d57dc3dd7e1d88d6d8b58693afc7178637fe6dcc8fe62e8dbe60fd8958: Status 404 returned error can't find the container with id e2efb2d57dc3dd7e1d88d6d8b58693afc7178637fe6dcc8fe62e8dbe60fd8958 Jul 14 20:23:20.080153 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:20.080128 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-v5qv8"] Jul 14 20:23:20.083108 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:23:20.083086 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ef12939_a949_42ed_9226_2b89594022c0.slice/crio-4abcec8db0959ef509fc75d966a26aae986824faebdf8cf982e755550147d05b WatchSource:0}: Error finding container 4abcec8db0959ef509fc75d966a26aae986824faebdf8cf982e755550147d05b: Status 404 returned error can't find the container with id 4abcec8db0959ef509fc75d966a26aae986824faebdf8cf982e755550147d05b Jul 14 20:23:20.283285 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:20.283178 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v5qv8" event={"ID":"2ef12939-a949-42ed-9226-2b89594022c0","Type":"ContainerStarted","Data":"4abcec8db0959ef509fc75d966a26aae986824faebdf8cf982e755550147d05b"} Jul 14 20:23:20.284393 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:20.284368 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q97sn" event={"ID":"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776","Type":"ContainerStarted","Data":"e2efb2d57dc3dd7e1d88d6d8b58693afc7178637fe6dcc8fe62e8dbe60fd8958"} Jul 14 20:23:20.730560 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:20.730518 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:23:20.731023 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:20.730581 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:23:20.731023 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:20.730703 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:20.731023 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:20.730773 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:52.730754822 +0000 UTC m=+99.298870781 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:23:20.731023 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:20.730714 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:23:20.731023 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:20.730809 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:23:20.731023 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:20.730848 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:23:52.730834935 +0000 UTC m=+99.298950891 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:23:25.298972 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:25.298853 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-v5qv8" event={"ID":"2ef12939-a949-42ed-9226-2b89594022c0","Type":"ContainerStarted","Data":"87c77d09e3083dd3ae9a9dacc139a83df7d3888e0afac24316a1e3671eb546ed"} Jul 14 20:23:25.298972 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:25.298926 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:23:25.300439 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:25.300407 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-q97sn" event={"ID":"27a6cb5c-dfe0-4f10-b8b1-7f58739f0776","Type":"ContainerStarted","Data":"1ddd354204c34ef9c35e7c2279d4349fa5ae6b1296371b19d0b1733b354e045d"} Jul 14 20:23:25.312930 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:25.312879 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-v5qv8" podStartSLOduration=66.605751019 podStartE2EDuration="1m11.312865393s" totalImagesPullingTime="4.707114374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:25.312166122 +0000 UTC m=+71.880282125" watchObservedRunningTime="2026-07-14 20:23:25.312865393 +0000 UTC m=+71.880981370" Jul 14 20:23:25.325453 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:25.325399 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-q97sn" podStartSLOduration=66.366727583 podStartE2EDuration="1m11.32538287s" totalImagesPullingTime="4.958655287s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:23:25.325010194 +0000 UTC m=+71.893126171" watchObservedRunningTime="2026-07-14 20:23:25.32538287 +0000 UTC m=+71.893498849" Jul 14 20:23:52.764264 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:52.764163 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:23:52.764264 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:52.764214 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:23:52.764673 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:52.764323 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:23:52.764673 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:52.764395 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:24:56.764379954 +0000 UTC m=+163.332495909 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:23:52.764673 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:52.764329 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:23:52.764673 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:52.764426 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:23:52.764673 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:23:52.764511 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:24:56.764497607 +0000 UTC m=+163.332613575 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:23:56.305186 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:23:56.305156 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-v5qv8" Jul 14 20:24:23.676047 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:24:23.675998 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:24:23.676538 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:23.676137 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 20:24:23.676538 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:23.676196 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:26:25.676180844 +0000 UTC m=+252.244296800 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : secret "metrics-daemon-secret" not found Jul 14 20:24:51.886274 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:51.886209 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" Jul 14 20:24:51.899435 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:51.899394 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n8snf" podUID="b3ecf8fa-fd1c-472c-8336-706a8f92fab7" Jul 14 20:24:52.009666 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:52.009624 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:24:52.510560 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:24:52.510528 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8snf" Jul 14 20:24:52.510716 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:24:52.510528 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:24:56.819337 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:24:56.819300 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:24:56.819785 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:24:56.819397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:24:56.819785 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:56.819460 2566 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 14 20:24:56.819785 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:56.819480 2566 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fd69b8c94-x4p6t: secret "image-registry-tls" not found Jul 14 20:24:56.819785 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:56.819490 2566 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 14 20:24:56.819785 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:56.819547 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls podName:b08d123b-73d4-4176-81d7-7672a46c2907 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:58.819526438 +0000 UTC m=+285.387642410 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls") pod "image-registry-fd69b8c94-x4p6t" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907") : secret "image-registry-tls" not found Jul 14 20:24:56.819785 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:24:56.819563 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls podName:b3ecf8fa-fd1c-472c-8336-706a8f92fab7 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:58.819555299 +0000 UTC m=+285.387671260 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls") pod "dns-default-n8snf" (UID: "b3ecf8fa-fd1c-472c-8336-706a8f92fab7") : secret "dns-default-metrics-tls" not found Jul 14 20:25:03.998862 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:25:03.998823 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:26:12.692486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.692450 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc"] Jul 14 20:26:12.694532 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.694513 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" Jul 14 20:26:12.696724 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.696702 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-m9k2f\"" Jul 14 20:26:12.696836 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.696765 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 14 20:26:12.697159 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.697145 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:26:12.703834 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.703814 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p"] Jul 14 20:26:12.705733 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.705716 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz"] Jul 14 20:26:12.705867 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.705846 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:12.707309 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.707289 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p"] Jul 14 20:26:12.707423 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.707405 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" Jul 14 20:26:12.708352 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.708308 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 14 20:26:12.708644 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.708628 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-57kbl\"" Jul 14 20:26:12.708896 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.708880 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 14 20:26:12.709192 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.709173 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-l7rt5\"" Jul 14 20:26:12.709301 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.709283 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kk8gz"] Jul 14 20:26:12.709404 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.709389 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.709491 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.709469 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:26:12.711094 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.711077 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc"] Jul 14 20:26:12.711185 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.711139 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:12.715386 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.715368 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k6wqk\"" Jul 14 20:26:12.715581 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.715566 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hm2q9\"" Jul 14 20:26:12.715653 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.715608 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 14 20:26:12.716109 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.716090 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 14 20:26:12.716223 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.716112 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 14 20:26:12.716223 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.716087 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 14 20:26:12.716396 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.716377 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 14 20:26:12.716460 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.716100 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 14 20:26:12.721569 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.721549 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p"] Jul 14 20:26:12.724243 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.724219 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kk8gz"] Jul 14 20:26:12.727178 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.727155 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz"] Jul 14 20:26:12.731033 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.731012 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p"] Jul 14 20:26:12.795144 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.795101 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5"] Jul 14 20:26:12.797356 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.797334 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-78b47967f6-8lb62"] Jul 14 20:26:12.797486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.797450 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:12.798984 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.798949 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:12.799596 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.799580 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 14 20:26:12.802566 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.802548 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 14 20:26:12.802759 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.802739 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 14 20:26:12.803387 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803366 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:26:12.803471 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803389 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 14 20:26:12.803537 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803510 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 14 20:26:12.803655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803638 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 14 20:26:12.804091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803642 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-88ltv\"" Jul 14 20:26:12.804091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803674 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 14 20:26:12.804091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803692 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 14 20:26:12.804091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803715 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fwfdr\"" Jul 14 20:26:12.804091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.803760 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 14 20:26:12.815634 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.815609 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78b47967f6-8lb62"] Jul 14 20:26:12.816469 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.816452 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5"] Jul 14 20:26:12.849823 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.849799 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c122e606-daba-4981-b063-721bdaad6564-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:12.849823 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.849828 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcbk\" (UniqueName: \"kubernetes.io/projected/ae2d504e-abed-4a83-92c3-352bf9c436ea-kube-api-access-nlcbk\") pod \"volume-data-source-validator-78495597f6-lkdjc\" (UID: \"ae2d504e-abed-4a83-92c3-352bf9c436ea\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.849866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2f20ab00-ed02-408e-a706-676ccfc2fc38-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.849942 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qhcsf\" (UniqueName: \"kubernetes.io/projected/610bc769-e332-4632-a8e4-aec1fa0c7fbc-kube-api-access-qhcsf\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.849995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.850019 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.850041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94k5\" (UniqueName: \"kubernetes.io/projected/644ad826-bda4-4628-97cc-734215746caa-kube-api-access-p94k5\") pod \"network-check-source-869dcfcdcd-47dpz\" (UID: \"644ad826-bda4-4628-97cc-734215746caa\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.850067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6xb9\" (UniqueName: \"kubernetes.io/projected/2f20ab00-ed02-408e-a706-676ccfc2fc38-kube-api-access-x6xb9\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.850128 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.850092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:12.889281 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.889257 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-rt2pp"] Jul 14 20:26:12.891744 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.891730 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:12.893683 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.893663 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 14 20:26:12.894097 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.894077 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 14 20:26:12.894194 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.894079 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:26:12.894194 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.894116 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 14 20:26:12.894194 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.894119 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kvqm4\"" Jul 14 20:26:12.900162 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.900133 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 14 20:26:12.901621 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.901600 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rt2pp"] Jul 14 20:26:12.951341 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951241 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c122e606-daba-4981-b063-721bdaad6564-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:12.951341 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951296 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-default-certificate\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:12.951341 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951316 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g7nl\" (UniqueName: \"kubernetes.io/projected/5f9692de-108f-4a8c-a734-a8fb6014a7cc-kube-api-access-9g7nl\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:12.951341 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951332 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f56ce6-a776-4d87-bac9-651b9fbee27c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951354 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2f20ab00-ed02-408e-a706-676ccfc2fc38-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951379 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951406 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951433 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94k5\" (UniqueName: \"kubernetes.io/projected/644ad826-bda4-4628-97cc-734215746caa-kube-api-access-p94k5\") pod \"network-check-source-869dcfcdcd-47dpz\" (UID: \"644ad826-bda4-4628-97cc-734215746caa\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6xb9\" (UniqueName: \"kubernetes.io/projected/2f20ab00-ed02-408e-a706-676ccfc2fc38-kube-api-access-x6xb9\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951494 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:12.951497 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:12.951552 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951561 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:12.951637 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:12.951574 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls podName:2f20ab00-ed02-408e-a706-676ccfc2fc38 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:13.451551953 +0000 UTC m=+240.019667908 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6l28p" (UID: "2f20ab00-ed02-408e-a706-676ccfc2fc38") : secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951686 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcbk\" (UniqueName: \"kubernetes.io/projected/ae2d504e-abed-4a83-92c3-352bf9c436ea-kube-api-access-nlcbk\") pod \"volume-data-source-validator-78495597f6-lkdjc\" (UID: \"ae2d504e-abed-4a83-92c3-352bf9c436ea\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:12.951724 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert podName:c122e606-daba-4981-b063-721bdaad6564 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:13.451691495 +0000 UTC m=+240.019807463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kk8gz" (UID: "c122e606-daba-4981-b063-721bdaad6564") : secret "networking-console-plugin-cert" not found Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951758 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5mb\" (UniqueName: \"kubernetes.io/projected/d1f56ce6-a776-4d87-bac9-651b9fbee27c-kube-api-access-7l5mb\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951830 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qhcsf\" (UniqueName: \"kubernetes.io/projected/610bc769-e332-4632-a8e4-aec1fa0c7fbc-kube-api-access-qhcsf\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951866 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1f56ce6-a776-4d87-bac9-651b9fbee27c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951892 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-stats-auth\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.951920 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.952022 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c122e606-daba-4981-b063-721bdaad6564-nginx-conf\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:12.952054 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.952098 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/2f20ab00-ed02-408e-a706-676ccfc2fc38-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:12.952156 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:12.952108 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls podName:610bc769-e332-4632-a8e4-aec1fa0c7fbc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:13.452094435 +0000 UTC m=+240.020210404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls") pod "cluster-samples-operator-65db858894-fj98p" (UID: "610bc769-e332-4632-a8e4-aec1fa0c7fbc") : secret "samples-operator-tls" not found Jul 14 20:26:12.960428 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.960396 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcbk\" (UniqueName: \"kubernetes.io/projected/ae2d504e-abed-4a83-92c3-352bf9c436ea-kube-api-access-nlcbk\") pod \"volume-data-source-validator-78495597f6-lkdjc\" (UID: \"ae2d504e-abed-4a83-92c3-352bf9c436ea\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" Jul 14 20:26:12.960694 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.960674 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qhcsf\" (UniqueName: \"kubernetes.io/projected/610bc769-e332-4632-a8e4-aec1fa0c7fbc-kube-api-access-qhcsf\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:12.960830 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.960815 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94k5\" (UniqueName: \"kubernetes.io/projected/644ad826-bda4-4628-97cc-734215746caa-kube-api-access-p94k5\") pod \"network-check-source-869dcfcdcd-47dpz\" (UID: \"644ad826-bda4-4628-97cc-734215746caa\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" Jul 14 20:26:12.961034 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:12.961014 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6xb9\" (UniqueName: \"kubernetes.io/projected/2f20ab00-ed02-408e-a706-676ccfc2fc38-kube-api-access-x6xb9\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:13.003951 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.003915 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" Jul 14 20:26:13.023687 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.023650 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" Jul 14 20:26:13.054064 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054006 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.054064 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054058 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054117 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5mb\" (UniqueName: \"kubernetes.io/projected/d1f56ce6-a776-4d87-bac9-651b9fbee27c-kube-api-access-7l5mb\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4p2j\" (UniqueName: \"kubernetes.io/projected/99b24900-fe71-4aed-a29c-087896ece95d-kube-api-access-p4p2j\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1f56ce6-a776-4d87-bac9-651b9fbee27c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.054236 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054247 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-stats-auth\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054294 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99b24900-fe71-4aed-a29c-087896ece95d-serving-cert\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.054315 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.054311 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:13.554288761 +0000 UTC m=+240.122404737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : secret "router-metrics-certs-default" not found Jul 14 20:26:13.054917 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054356 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b24900-fe71-4aed-a29c-087896ece95d-config\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.054917 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054397 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-default-certificate\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.054917 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054427 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g7nl\" (UniqueName: \"kubernetes.io/projected/5f9692de-108f-4a8c-a734-a8fb6014a7cc-kube-api-access-9g7nl\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.054917 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054454 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f56ce6-a776-4d87-bac9-651b9fbee27c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.054917 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.054482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99b24900-fe71-4aed-a29c-087896ece95d-trusted-ca\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.054917 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.054783 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:13.554765921 +0000 UTC m=+240.122881880 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : configmap references non-existent config key: service-ca.crt Jul 14 20:26:13.055489 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.055354 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d1f56ce6-a776-4d87-bac9-651b9fbee27c-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.058042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.057996 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-stats-auth\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.058042 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.058004 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-default-certificate\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.058354 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.058330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d1f56ce6-a776-4d87-bac9-651b9fbee27c-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.066107 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.065779 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g7nl\" (UniqueName: \"kubernetes.io/projected/5f9692de-108f-4a8c-a734-a8fb6014a7cc-kube-api-access-9g7nl\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.066107 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.066058 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5mb\" (UniqueName: \"kubernetes.io/projected/d1f56ce6-a776-4d87-bac9-651b9fbee27c-kube-api-access-7l5mb\") pod \"kube-storage-version-migrator-operator-799cb7f958-wg8n5\" (UID: \"d1f56ce6-a776-4d87-bac9-651b9fbee27c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.107528 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.107488 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" Jul 14 20:26:13.143584 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.143550 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc"] Jul 14 20:26:13.147057 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:13.147031 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae2d504e_abed_4a83_92c3_352bf9c436ea.slice/crio-2c6f32fbb4e177851fa7b5c32af296aea64a5c8e75167aa4bbf031c54f2bcee9 WatchSource:0}: Error finding container 2c6f32fbb4e177851fa7b5c32af296aea64a5c8e75167aa4bbf031c54f2bcee9: Status 404 returned error can't find the container with id 2c6f32fbb4e177851fa7b5c32af296aea64a5c8e75167aa4bbf031c54f2bcee9 Jul 14 20:26:13.155499 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.155469 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99b24900-fe71-4aed-a29c-087896ece95d-serving-cert\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.155626 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.155517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b24900-fe71-4aed-a29c-087896ece95d-config\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.155626 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.155560 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99b24900-fe71-4aed-a29c-087896ece95d-trusted-ca\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.155626 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.155602 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz"] Jul 14 20:26:13.155766 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.155680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4p2j\" (UniqueName: \"kubernetes.io/projected/99b24900-fe71-4aed-a29c-087896ece95d-kube-api-access-p4p2j\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.156447 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.156418 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/99b24900-fe71-4aed-a29c-087896ece95d-config\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.156619 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.156578 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/99b24900-fe71-4aed-a29c-087896ece95d-trusted-ca\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.158173 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.158130 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/99b24900-fe71-4aed-a29c-087896ece95d-serving-cert\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.159979 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:13.159888 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644ad826_bda4_4628_97cc_734215746caa.slice/crio-9436c4cc1cc10e2c5b0d3526e86e2b4ad7e93138fc98e2fe87c5b7e1ed10c72b WatchSource:0}: Error finding container 9436c4cc1cc10e2c5b0d3526e86e2b4ad7e93138fc98e2fe87c5b7e1ed10c72b: Status 404 returned error can't find the container with id 9436c4cc1cc10e2c5b0d3526e86e2b4ad7e93138fc98e2fe87c5b7e1ed10c72b Jul 14 20:26:13.163347 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.163324 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4p2j\" (UniqueName: \"kubernetes.io/projected/99b24900-fe71-4aed-a29c-087896ece95d-kube-api-access-p4p2j\") pod \"console-operator-7866497494-rt2pp\" (UID: \"99b24900-fe71-4aed-a29c-087896ece95d\") " pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.201985 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.201889 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:13.244633 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.244602 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5"] Jul 14 20:26:13.248172 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:13.248125 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1f56ce6_a776_4d87_bac9_651b9fbee27c.slice/crio-5e726b902e312038395dc2538dfbb817491429e64969d31c3f4ad1fee93835bc WatchSource:0}: Error finding container 5e726b902e312038395dc2538dfbb817491429e64969d31c3f4ad1fee93835bc: Status 404 returned error can't find the container with id 5e726b902e312038395dc2538dfbb817491429e64969d31c3f4ad1fee93835bc Jul 14 20:26:13.340067 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.339988 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-rt2pp"] Jul 14 20:26:13.343760 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:13.343734 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b24900_fe71_4aed_a29c_087896ece95d.slice/crio-6299e4433f2a5e4bef9c60f23394055248b82de6cc8fe1abf0b70368882dfbcd WatchSource:0}: Error finding container 6299e4433f2a5e4bef9c60f23394055248b82de6cc8fe1abf0b70368882dfbcd: Status 404 returned error can't find the container with id 6299e4433f2a5e4bef9c60f23394055248b82de6cc8fe1abf0b70368882dfbcd Jul 14 20:26:13.458025 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.457922 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:13.458183 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.458029 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:13.458183 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.458053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:13.458183 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.458089 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 20:26:13.458183 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.458152 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls podName:610bc769-e332-4632-a8e4-aec1fa0c7fbc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:14.458137335 +0000 UTC m=+241.026253293 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls") pod "cluster-samples-operator-65db858894-fj98p" (UID: "610bc769-e332-4632-a8e4-aec1fa0c7fbc") : secret "samples-operator-tls" not found Jul 14 20:26:13.458183 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.458178 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 20:26:13.458364 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.458221 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert podName:c122e606-daba-4981-b063-721bdaad6564 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:14.458210469 +0000 UTC m=+241.026326425 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kk8gz" (UID: "c122e606-daba-4981-b063-721bdaad6564") : secret "networking-console-plugin-cert" not found Jul 14 20:26:13.458364 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.458177 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:13.458364 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.458250 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls podName:2f20ab00-ed02-408e-a706-676ccfc2fc38 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:14.458244238 +0000 UTC m=+241.026360193 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6l28p" (UID: "2f20ab00-ed02-408e-a706-676ccfc2fc38") : secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:13.558485 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.558443 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.558485 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.558482 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:13.558693 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.558623 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 20:26:13.558693 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.558641 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:14.558619835 +0000 UTC m=+241.126735801 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : configmap references non-existent config key: service-ca.crt Jul 14 20:26:13.558693 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:13.558663 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:14.558652606 +0000 UTC m=+241.126768561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : secret "router-metrics-certs-default" not found Jul 14 20:26:13.706022 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.705982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" event={"ID":"d1f56ce6-a776-4d87-bac9-651b9fbee27c","Type":"ContainerStarted","Data":"5e726b902e312038395dc2538dfbb817491429e64969d31c3f4ad1fee93835bc"} Jul 14 20:26:13.707066 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.707036 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rt2pp" event={"ID":"99b24900-fe71-4aed-a29c-087896ece95d","Type":"ContainerStarted","Data":"6299e4433f2a5e4bef9c60f23394055248b82de6cc8fe1abf0b70368882dfbcd"} Jul 14 20:26:13.708105 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.708033 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" event={"ID":"ae2d504e-abed-4a83-92c3-352bf9c436ea","Type":"ContainerStarted","Data":"2c6f32fbb4e177851fa7b5c32af296aea64a5c8e75167aa4bbf031c54f2bcee9"} Jul 14 20:26:13.709431 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.709408 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" event={"ID":"644ad826-bda4-4628-97cc-734215746caa","Type":"ContainerStarted","Data":"e071ba8a922fd11172fabb5646e06a7deaad652687df5ca2897c8eb5bde81164"} Jul 14 20:26:13.709526 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.709444 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" event={"ID":"644ad826-bda4-4628-97cc-734215746caa","Type":"ContainerStarted","Data":"9436c4cc1cc10e2c5b0d3526e86e2b4ad7e93138fc98e2fe87c5b7e1ed10c72b"} Jul 14 20:26:13.725468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:13.725413 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-47dpz" podStartSLOduration=1.725393957 podStartE2EDuration="1.725393957s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:13.723546205 +0000 UTC m=+240.291662181" watchObservedRunningTime="2026-07-14 20:26:13.725393957 +0000 UTC m=+240.293509936" Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:14.466704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:14.466829 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:14.466862 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.467091 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.467160 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert podName:c122e606-daba-4981-b063-721bdaad6564 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:16.467138985 +0000 UTC m=+243.035254966 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kk8gz" (UID: "c122e606-daba-4981-b063-721bdaad6564") : secret "networking-console-plugin-cert" not found Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.467596 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.467647 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls podName:610bc769-e332-4632-a8e4-aec1fa0c7fbc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:16.467631215 +0000 UTC m=+243.035747173 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls") pod "cluster-samples-operator-65db858894-fj98p" (UID: "610bc769-e332-4632-a8e4-aec1fa0c7fbc") : secret "samples-operator-tls" not found Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.467708 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:14.467776 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.467743 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls podName:2f20ab00-ed02-408e-a706-676ccfc2fc38 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:16.467731995 +0000 UTC m=+243.035847949 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6l28p" (UID: "2f20ab00-ed02-408e-a706-676ccfc2fc38") : secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:14.567899 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:14.567853 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:14.567899 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:14.567904 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:14.568149 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.568067 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:16.56804412 +0000 UTC m=+243.136160087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : configmap references non-existent config key: service-ca.crt Jul 14 20:26:14.568149 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.568109 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 20:26:14.568268 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:14.568160 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:16.568143239 +0000 UTC m=+243.136259197 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : secret "router-metrics-certs-default" not found Jul 14 20:26:15.717676 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:15.717636 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" event={"ID":"ae2d504e-abed-4a83-92c3-352bf9c436ea","Type":"ContainerStarted","Data":"306262de9fc828ab3ac07846b6156d27e5a6111c0b020f010154b3584f40635c"} Jul 14 20:26:15.732370 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:15.732314 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-lkdjc" podStartSLOduration=2.189635391 podStartE2EDuration="3.732294908s" totalImagesPullingTime="1.542659517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:15.731479063 +0000 UTC m=+242.299595044" watchObservedRunningTime="2026-07-14 20:26:15.732294908 +0000 UTC m=+242.300410883" Jul 14 20:26:16.483786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.483744 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:16.484027 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.483812 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:16.484027 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.483899 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:16.484027 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.483916 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 20:26:16.484027 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.483943 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:16.484027 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.483980 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls podName:2f20ab00-ed02-408e-a706-676ccfc2fc38 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:20.483945089 +0000 UTC m=+247.052061047 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6l28p" (UID: "2f20ab00-ed02-408e-a706-676ccfc2fc38") : secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:16.484027 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.484000 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls podName:610bc769-e332-4632-a8e4-aec1fa0c7fbc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:20.483991302 +0000 UTC m=+247.052107257 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls") pod "cluster-samples-operator-65db858894-fj98p" (UID: "610bc769-e332-4632-a8e4-aec1fa0c7fbc") : secret "samples-operator-tls" not found Jul 14 20:26:16.484573 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.484046 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 20:26:16.484573 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.484112 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert podName:c122e606-daba-4981-b063-721bdaad6564 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:20.484096095 +0000 UTC m=+247.052212051 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kk8gz" (UID: "c122e606-daba-4981-b063-721bdaad6564") : secret "networking-console-plugin-cert" not found Jul 14 20:26:16.585542 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.585498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:16.585690 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.585550 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:16.585690 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.585669 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:20.585651173 +0000 UTC m=+247.153767128 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : configmap references non-existent config key: service-ca.crt Jul 14 20:26:16.585803 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.585714 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 20:26:16.585803 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:16.585773 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:20.585757366 +0000 UTC m=+247.153873324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : secret "router-metrics-certs-default" not found Jul 14 20:26:16.722443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.722409 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" event={"ID":"d1f56ce6-a776-4d87-bac9-651b9fbee27c","Type":"ContainerStarted","Data":"0ff15838e12b56e12da1d610133f1b880d1f8a6c7de8f1b0b498b7e42cfeaa6b"} Jul 14 20:26:16.724061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.724038 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/0.log" Jul 14 20:26:16.724181 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.724087 2566 generic.go:356] "Generic (PLEG): container finished" podID="99b24900-fe71-4aed-a29c-087896ece95d" containerID="6c5785627bbd580ea2e13a5ddc9c56ef7f86a912957d249e581db64cdee81522" exitCode=255 Jul 14 20:26:16.724181 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.724168 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rt2pp" event={"ID":"99b24900-fe71-4aed-a29c-087896ece95d","Type":"ContainerDied","Data":"6c5785627bbd580ea2e13a5ddc9c56ef7f86a912957d249e581db64cdee81522"} Jul 14 20:26:16.724315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.724302 2566 scope.go:117] "RemoveContainer" containerID="6c5785627bbd580ea2e13a5ddc9c56ef7f86a912957d249e581db64cdee81522" Jul 14 20:26:16.737195 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:16.737110 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" podStartSLOduration=2.067365002 podStartE2EDuration="4.73709107s" totalImagesPullingTime="2.669726068s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:16.735586876 +0000 UTC m=+243.303702856" watchObservedRunningTime="2026-07-14 20:26:16.73709107 +0000 UTC m=+243.305207048" Jul 14 20:26:17.728259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:17.728234 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:26:17.728698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:17.728659 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/0.log" Jul 14 20:26:17.728698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:17.728689 2566 generic.go:356] "Generic (PLEG): container finished" podID="99b24900-fe71-4aed-a29c-087896ece95d" containerID="3e18210f03a372d12e0dc056245d9323a18a00091416b18b4f64131e6a5de605" exitCode=255 Jul 14 20:26:17.728780 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:17.728760 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rt2pp" event={"ID":"99b24900-fe71-4aed-a29c-087896ece95d","Type":"ContainerDied","Data":"3e18210f03a372d12e0dc056245d9323a18a00091416b18b4f64131e6a5de605"} Jul 14 20:26:17.728814 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:17.728807 2566 scope.go:117] "RemoveContainer" containerID="6c5785627bbd580ea2e13a5ddc9c56ef7f86a912957d249e581db64cdee81522" Jul 14 20:26:17.729053 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:17.729031 2566 scope.go:117] "RemoveContainer" containerID="3e18210f03a372d12e0dc056245d9323a18a00091416b18b4f64131e6a5de605" Jul 14 20:26:17.729246 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:17.729224 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rt2pp_openshift-console-operator(99b24900-fe71-4aed-a29c-087896ece95d)\"" pod="openshift-console-operator/console-operator-7866497494-rt2pp" podUID="99b24900-fe71-4aed-a29c-087896ece95d" Jul 14 20:26:18.060531 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.060495 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-27hwc"] Jul 14 20:26:18.064430 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.064408 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.066455 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.066434 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 14 20:26:18.066566 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.066519 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 14 20:26:18.066566 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.066530 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 14 20:26:18.066566 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.066546 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lxqqx\"" Jul 14 20:26:18.066717 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.066672 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 14 20:26:18.075946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.075927 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27hwc"] Jul 14 20:26:18.099116 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.099087 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppjtv\" (UniqueName: \"kubernetes.io/projected/02ebf343-fa4c-47d2-831e-14993565d579-kube-api-access-ppjtv\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.099223 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.099155 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02ebf343-fa4c-47d2-831e-14993565d579-crio-socket\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.099223 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.099211 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.099292 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.099245 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.099339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.099315 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02ebf343-fa4c-47d2-831e-14993565d579-data-volume\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200107 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200005 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppjtv\" (UniqueName: \"kubernetes.io/projected/02ebf343-fa4c-47d2-831e-14993565d579-kube-api-access-ppjtv\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200276 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200190 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02ebf343-fa4c-47d2-831e-14993565d579-crio-socket\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200276 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200219 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200276 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200250 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200276 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200273 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02ebf343-fa4c-47d2-831e-14993565d579-data-volume\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200502 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200318 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02ebf343-fa4c-47d2-831e-14993565d579-crio-socket\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.200502 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.200345 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:18.200502 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.200378 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.200502 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.200416 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:18.700392457 +0000 UTC m=+245.268508426 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : configmap "kube-rbac-proxy" not found Jul 14 20:26:18.200502 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.200437 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:18.700427612 +0000 UTC m=+245.268543580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.200732 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.200564 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02ebf343-fa4c-47d2-831e-14993565d579-data-volume\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.210240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.210218 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppjtv\" (UniqueName: \"kubernetes.io/projected/02ebf343-fa4c-47d2-831e-14993565d579-kube-api-access-ppjtv\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.704493 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.704446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.704672 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.704609 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.704672 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.704644 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:18.704753 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.704700 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:19.704660406 +0000 UTC m=+246.272776381 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:18.704753 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.704704 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:18.704819 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.704757 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:19.704746088 +0000 UTC m=+246.272862048 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : configmap "kube-rbac-proxy" not found Jul 14 20:26:18.733630 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.733604 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:26:18.733988 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:18.733927 2566 scope.go:117] "RemoveContainer" containerID="3e18210f03a372d12e0dc056245d9323a18a00091416b18b4f64131e6a5de605" Jul 14 20:26:18.734114 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:18.734094 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rt2pp_openshift-console-operator(99b24900-fe71-4aed-a29c-087896ece95d)\"" pod="openshift-console-operator/console-operator-7866497494-rt2pp" podUID="99b24900-fe71-4aed-a29c-087896ece95d" Jul 14 20:26:19.716118 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:19.716053 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:19.716331 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:19.716133 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:19.716331 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:19.716201 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:19.716331 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:19.716273 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:21.716254818 +0000 UTC m=+248.284370773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : configmap "kube-rbac-proxy" not found Jul 14 20:26:19.716331 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:19.716273 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:19.716331 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:19.716324 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:21.716309029 +0000 UTC m=+248.284424985 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:20.522008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:20.521929 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:20.522048 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:20.522075 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.522084 2566 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.522174 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls podName:610bc769-e332-4632-a8e4-aec1fa0c7fbc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:28.522153499 +0000 UTC m=+255.090269460 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls") pod "cluster-samples-operator-65db858894-fj98p" (UID: "610bc769-e332-4632-a8e4-aec1fa0c7fbc") : secret "samples-operator-tls" not found Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.522196 2566 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.522249 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls podName:2f20ab00-ed02-408e-a706-676ccfc2fc38 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:28.522238957 +0000 UTC m=+255.090354915 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-6l28p" (UID: "2f20ab00-ed02-408e-a706-676ccfc2fc38") : secret "cluster-monitoring-operator-tls" not found Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.522257 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 20:26:20.522408 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.522315 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert podName:c122e606-daba-4981-b063-721bdaad6564 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:28.522301296 +0000 UTC m=+255.090417254 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kk8gz" (UID: "c122e606-daba-4981-b063-721bdaad6564") : secret "networking-console-plugin-cert" not found Jul 14 20:26:20.623227 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:20.623192 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:20.623227 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:20.623229 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:20.623400 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.623385 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:28.623364499 +0000 UTC m=+255.191480461 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : configmap references non-existent config key: service-ca.crt Jul 14 20:26:20.623448 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.623386 2566 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 14 20:26:20.623448 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:20.623431 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs podName:5f9692de-108f-4a8c-a734-a8fb6014a7cc nodeName:}" failed. No retries permitted until 2026-07-14 20:26:28.623421381 +0000 UTC m=+255.191537341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs") pod "router-default-78b47967f6-8lb62" (UID: "5f9692de-108f-4a8c-a734-a8fb6014a7cc") : secret "router-metrics-certs-default" not found Jul 14 20:26:20.651437 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:20.651415 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-946bq_9dafb0b0-ceaa-478c-888e-14bf94c8eb00/dns-node-resolver/0.log" Jul 14 20:26:21.733758 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:21.733723 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:21.733758 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:21.733764 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:21.734236 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:21.733859 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:21.734236 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:21.733935 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:25.733915311 +0000 UTC m=+252.302031282 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : configmap "kube-rbac-proxy" not found Jul 14 20:26:21.734236 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:21.734008 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:21.734236 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:21.734050 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:25.734038337 +0000 UTC m=+252.302154292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:21.851981 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:21.851929 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mr9tb_01c6eacb-abb9-4785-8b13-85d283cb56e9/node-ca/0.log" Jul 14 20:26:22.451766 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:22.451736 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7kz89_84644784-a141-4dda-b4e1-089ed1b2e26b/serve-healthcheck-canary/0.log" Jul 14 20:26:23.202712 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:23.202671 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:23.203235 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:23.202734 2566 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:23.203235 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:23.203181 2566 scope.go:117] "RemoveContainer" containerID="3e18210f03a372d12e0dc056245d9323a18a00091416b18b4f64131e6a5de605" Jul 14 20:26:23.203399 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:23.203375 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-rt2pp_openshift-console-operator(99b24900-fe71-4aed-a29c-087896ece95d)\"" pod="openshift-console-operator/console-operator-7866497494-rt2pp" podUID="99b24900-fe71-4aed-a29c-087896ece95d" Jul 14 20:26:23.452086 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:23.452049 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wg8n5_d1f56ce6-a776-4d87-bac9-651b9fbee27c/kube-storage-version-migrator-operator/0.log" Jul 14 20:26:25.773480 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:25.773442 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:25.773596 2566 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:25.773615 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:25.773643 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:25.773657 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs podName:941f6ef3-8ea0-4657-8b97-91ce535dc8ab nodeName:}" failed. No retries permitted until 2026-07-14 20:28:27.773640678 +0000 UTC m=+374.341756634 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs") pod "network-metrics-daemon-r9mdm" (UID: "941f6ef3-8ea0-4657-8b97-91ce535dc8ab") : secret "metrics-daemon-secret" not found Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:25.773726 2566 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:25.773728 2566 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:25.773776 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:33.77376044 +0000 UTC m=+260.341876396 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : secret "insights-runtime-extractor-tls" not found Jul 14 20:26:25.773844 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:25.773790 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm podName:02ebf343-fa4c-47d2-831e-14993565d579 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:33.773783891 +0000 UTC m=+260.341899845 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm") pod "insights-runtime-extractor-27hwc" (UID: "02ebf343-fa4c-47d2-831e-14993565d579") : configmap "kube-rbac-proxy" not found Jul 14 20:26:28.596641 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.596603 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:28.596641 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.596642 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:28.597099 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:28.596741 2566 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 14 20:26:28.597099 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:28.596794 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert podName:c122e606-daba-4981-b063-721bdaad6564 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:44.596780087 +0000 UTC m=+271.164896043 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-kk8gz" (UID: "c122e606-daba-4981-b063-721bdaad6564") : secret "networking-console-plugin-cert" not found Jul 14 20:26:28.597099 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.596858 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:28.599058 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.599032 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/2f20ab00-ed02-408e-a706-676ccfc2fc38-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-6l28p\" (UID: \"2f20ab00-ed02-408e-a706-676ccfc2fc38\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:28.599184 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.599084 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/610bc769-e332-4632-a8e4-aec1fa0c7fbc-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fj98p\" (UID: \"610bc769-e332-4632-a8e4-aec1fa0c7fbc\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:28.617652 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.617625 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-57kbl\"" Jul 14 20:26:28.626024 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.626000 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" Jul 14 20:26:28.636594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.636564 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-k6wqk\"" Jul 14 20:26:28.644238 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.644212 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" Jul 14 20:26:28.698247 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.698215 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:28.698344 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.698264 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:28.700403 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.700373 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9692de-108f-4a8c-a734-a8fb6014a7cc-service-ca-bundle\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:28.701257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.701236 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5f9692de-108f-4a8c-a734-a8fb6014a7cc-metrics-certs\") pod \"router-default-78b47967f6-8lb62\" (UID: \"5f9692de-108f-4a8c-a734-a8fb6014a7cc\") " pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:28.714693 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.714669 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fwfdr\"" Jul 14 20:26:28.723377 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.723343 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:28.763865 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.763833 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p"] Jul 14 20:26:28.782398 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.782362 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p"] Jul 14 20:26:28.786175 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:28.786126 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f20ab00_ed02_408e_a706_676ccfc2fc38.slice/crio-8fd77c5860cfce379aaed5a2e27881fe4ea0a81415eb5f028d444d675ee7fed8 WatchSource:0}: Error finding container 8fd77c5860cfce379aaed5a2e27881fe4ea0a81415eb5f028d444d675ee7fed8: Status 404 returned error can't find the container with id 8fd77c5860cfce379aaed5a2e27881fe4ea0a81415eb5f028d444d675ee7fed8 Jul 14 20:26:28.864461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:28.864382 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-78b47967f6-8lb62"] Jul 14 20:26:28.867720 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:28.867692 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9692de_108f_4a8c_a734_a8fb6014a7cc.slice/crio-0f2903548589bc4ec8d9ac6eaacbbfde3890c80cb88055d3f7bdd2c8d4c795f8 WatchSource:0}: Error finding container 0f2903548589bc4ec8d9ac6eaacbbfde3890c80cb88055d3f7bdd2c8d4c795f8: Status 404 returned error can't find the container with id 0f2903548589bc4ec8d9ac6eaacbbfde3890c80cb88055d3f7bdd2c8d4c795f8 Jul 14 20:26:29.768425 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:29.768383 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" event={"ID":"610bc769-e332-4632-a8e4-aec1fa0c7fbc","Type":"ContainerStarted","Data":"f4b4497aa3bc5b17edd12a19c1bd81b2cc7447cda239fcafa4bc65712454bf6f"} Jul 14 20:26:29.770283 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:29.770236 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78b47967f6-8lb62" event={"ID":"5f9692de-108f-4a8c-a734-a8fb6014a7cc","Type":"ContainerStarted","Data":"72a148cd8f6ea7fd648453f6d63114a4c803fa5728a5c6db57a7fe420c2c191e"} Jul 14 20:26:29.770423 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:29.770294 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-78b47967f6-8lb62" event={"ID":"5f9692de-108f-4a8c-a734-a8fb6014a7cc","Type":"ContainerStarted","Data":"0f2903548589bc4ec8d9ac6eaacbbfde3890c80cb88055d3f7bdd2c8d4c795f8"} Jul 14 20:26:29.771642 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:29.771607 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" event={"ID":"2f20ab00-ed02-408e-a706-676ccfc2fc38","Type":"ContainerStarted","Data":"8fd77c5860cfce379aaed5a2e27881fe4ea0a81415eb5f028d444d675ee7fed8"} Jul 14 20:26:29.788566 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:29.788513 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-78b47967f6-8lb62" podStartSLOduration=17.788494813 podStartE2EDuration="17.788494813s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:29.787181382 +0000 UTC m=+256.355297360" watchObservedRunningTime="2026-07-14 20:26:29.788494813 +0000 UTC m=+256.356610789" Jul 14 20:26:30.724169 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:30.724137 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:30.726575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:30.726550 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:30.775059 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:30.775024 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:30.776440 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:30.776405 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-78b47967f6-8lb62" Jul 14 20:26:31.779733 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:31.779696 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" event={"ID":"2f20ab00-ed02-408e-a706-676ccfc2fc38","Type":"ContainerStarted","Data":"ab6ddc0004a498a11d89eda4d2c8914be06f58b9be86f19550de4ae2638e61ca"} Jul 14 20:26:31.781552 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:31.781524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" event={"ID":"610bc769-e332-4632-a8e4-aec1fa0c7fbc","Type":"ContainerStarted","Data":"e1da199785e34719974db373552ff4909e4a2e141006fb86a106f7c4116bfbfb"} Jul 14 20:26:31.781664 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:31.781571 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" event={"ID":"610bc769-e332-4632-a8e4-aec1fa0c7fbc","Type":"ContainerStarted","Data":"26d4eaa028ba27b805c84e1a93c4286f0a9d573185f3dc43aa9be8e96df7a32c"} Jul 14 20:26:31.795668 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:31.795620 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-6l28p" podStartSLOduration=17.32078471 podStartE2EDuration="19.795604166s" totalImagesPullingTime="2.474819456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:31.795078673 +0000 UTC m=+258.363194650" watchObservedRunningTime="2026-07-14 20:26:31.795604166 +0000 UTC m=+258.363720142" Jul 14 20:26:31.812473 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:31.812423 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fj98p" podStartSLOduration=17.361406503 podStartE2EDuration="19.812407057s" totalImagesPullingTime="2.451000554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:31.811149653 +0000 UTC m=+258.379265641" watchObservedRunningTime="2026-07-14 20:26:31.812407057 +0000 UTC m=+258.380523034" Jul 14 20:26:33.842430 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:33.842376 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:33.842853 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:33.842508 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:33.843061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:33.843041 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02ebf343-fa4c-47d2-831e-14993565d579-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:33.844732 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:33.844707 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02ebf343-fa4c-47d2-831e-14993565d579-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-27hwc\" (UID: \"02ebf343-fa4c-47d2-831e-14993565d579\") " pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:33.973656 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:33.973602 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-27hwc" Jul 14 20:26:34.102886 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:34.102807 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-27hwc"] Jul 14 20:26:34.106419 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:34.106391 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ebf343_fa4c_47d2_831e_14993565d579.slice/crio-b1ba64dab6658d7439783315abf8cd4def039f07981e22648347f70e24ec7a88 WatchSource:0}: Error finding container b1ba64dab6658d7439783315abf8cd4def039f07981e22648347f70e24ec7a88: Status 404 returned error can't find the container with id b1ba64dab6658d7439783315abf8cd4def039f07981e22648347f70e24ec7a88 Jul 14 20:26:34.794168 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:34.794135 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27hwc" event={"ID":"02ebf343-fa4c-47d2-831e-14993565d579","Type":"ContainerStarted","Data":"b1ba64dab6658d7439783315abf8cd4def039f07981e22648347f70e24ec7a88"} Jul 14 20:26:34.998623 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:34.998374 2566 scope.go:117] "RemoveContainer" containerID="3e18210f03a372d12e0dc056245d9323a18a00091416b18b4f64131e6a5de605" Jul 14 20:26:35.800599 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:35.800567 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:26:35.800774 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:35.800659 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-rt2pp" event={"ID":"99b24900-fe71-4aed-a29c-087896ece95d","Type":"ContainerStarted","Data":"4d3a399e379574fcd61342d56f1d5b738891247d9600c7cd82da62c2d09d5850"} Jul 14 20:26:35.801114 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:35.801065 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:35.808094 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:35.808036 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-rt2pp" Jul 14 20:26:35.842822 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:35.842763 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-rt2pp" podStartSLOduration=21.267376461 podStartE2EDuration="23.842743699s" totalImagesPullingTime="2.575367238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:35.822086837 +0000 UTC m=+262.390202815" watchObservedRunningTime="2026-07-14 20:26:35.842743699 +0000 UTC m=+262.410859687" Jul 14 20:26:38.814826 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:38.814789 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27hwc" event={"ID":"02ebf343-fa4c-47d2-831e-14993565d579","Type":"ContainerStarted","Data":"8b1408b3c4646261b39bb1fcdc7acc97a82c660ca975629297c455a8a5fd0a87"} Jul 14 20:26:38.815209 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:38.814843 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27hwc" event={"ID":"02ebf343-fa4c-47d2-831e-14993565d579","Type":"ContainerStarted","Data":"ff73bc01cea7aadc77fcd0b4af7c0ec6743bce80304259d641b57a2e08f30a48"} Jul 14 20:26:41.826799 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:41.826765 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-27hwc" event={"ID":"02ebf343-fa4c-47d2-831e-14993565d579","Type":"ContainerStarted","Data":"3d3ac04776263eabf9bb1a24aaee4cf13713bdc2e938292b99f955630221d4b2"} Jul 14 20:26:41.842333 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:41.842284 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-27hwc" podStartSLOduration=16.704281567 podStartE2EDuration="23.842266867s" totalImagesPullingTime="7.1379853s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:26:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:41.841248576 +0000 UTC m=+268.409364564" watchObservedRunningTime="2026-07-14 20:26:41.842266867 +0000 UTC m=+268.410382846" Jul 14 20:26:44.639071 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.639021 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:44.641551 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.641524 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c122e606-daba-4981-b063-721bdaad6564-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-kk8gz\" (UID: \"c122e606-daba-4981-b063-721bdaad6564\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:44.695831 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.695796 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-d5tww"] Jul 14 20:26:44.698082 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.698063 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:26:44.699929 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.699907 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-9kgp4\"" Jul 14 20:26:44.700158 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.700092 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 14 20:26:44.700287 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.700215 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 14 20:26:44.717151 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.717125 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-d5tww"] Jul 14 20:26:44.840885 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.840850 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hm2q9\"" Jul 14 20:26:44.840885 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.840861 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq9th\" (UniqueName: \"kubernetes.io/projected/c4359acd-2829-4e52-a956-91c0b6865ed0-kube-api-access-vq9th\") pod \"downloads-68c9cbb497-d5tww\" (UID: \"c4359acd-2829-4e52-a956-91c0b6865ed0\") " pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:26:44.849694 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.849673 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" Jul 14 20:26:44.941582 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.941498 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq9th\" (UniqueName: \"kubernetes.io/projected/c4359acd-2829-4e52-a956-91c0b6865ed0-kube-api-access-vq9th\") pod \"downloads-68c9cbb497-d5tww\" (UID: \"c4359acd-2829-4e52-a956-91c0b6865ed0\") " pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:26:44.951372 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.951342 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq9th\" (UniqueName: \"kubernetes.io/projected/c4359acd-2829-4e52-a956-91c0b6865ed0-kube-api-access-vq9th\") pod \"downloads-68c9cbb497-d5tww\" (UID: \"c4359acd-2829-4e52-a956-91c0b6865ed0\") " pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:26:44.993449 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:44.993419 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-kk8gz"] Jul 14 20:26:44.996973 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:44.996925 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc122e606_daba_4981_b063_721bdaad6564.slice/crio-e4aefb1221b2672d98d04213058f12a24974f6e6de83c0d9951314536670af2c WatchSource:0}: Error finding container e4aefb1221b2672d98d04213058f12a24974f6e6de83c0d9951314536670af2c: Status 404 returned error can't find the container with id e4aefb1221b2672d98d04213058f12a24974f6e6de83c0d9951314536670af2c Jul 14 20:26:45.007778 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:45.007756 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:26:45.132193 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:45.132163 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-d5tww"] Jul 14 20:26:45.135337 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:45.135310 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4359acd_2829_4e52_a956_91c0b6865ed0.slice/crio-a8dcdc25d0444f569bbd23b24165ca25fecffa2a313454e702951b14562bb034 WatchSource:0}: Error finding container a8dcdc25d0444f569bbd23b24165ca25fecffa2a313454e702951b14562bb034: Status 404 returned error can't find the container with id a8dcdc25d0444f569bbd23b24165ca25fecffa2a313454e702951b14562bb034 Jul 14 20:26:45.842035 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:45.841994 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-d5tww" event={"ID":"c4359acd-2829-4e52-a956-91c0b6865ed0","Type":"ContainerStarted","Data":"a8dcdc25d0444f569bbd23b24165ca25fecffa2a313454e702951b14562bb034"} Jul 14 20:26:45.843007 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:45.842984 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" event={"ID":"c122e606-daba-4981-b063-721bdaad6564","Type":"ContainerStarted","Data":"e4aefb1221b2672d98d04213058f12a24974f6e6de83c0d9951314536670af2c"} Jul 14 20:26:47.829927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.829887 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xjlkb"] Jul 14 20:26:47.832709 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.832682 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:47.835838 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.835818 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 14 20:26:47.835985 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.835822 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hmxzb\"" Jul 14 20:26:47.835985 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.835823 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 14 20:26:47.835985 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.835823 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 14 20:26:47.841240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.841217 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xjlkb"] Jul 14 20:26:47.854037 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.854003 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" event={"ID":"c122e606-daba-4981-b063-721bdaad6564","Type":"ContainerStarted","Data":"f1eae77a6b7be5e6394b028681de9b3b539a52d7e8c857397c5862fc45e5bfcd"} Jul 14 20:26:47.869063 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.869009 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-kk8gz" podStartSLOduration=33.634831478 podStartE2EDuration="35.868988301s" totalImagesPullingTime="2.234156823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:47.868134081 +0000 UTC m=+274.436250058" watchObservedRunningTime="2026-07-14 20:26:47.868988301 +0000 UTC m=+274.437104279" Jul 14 20:26:47.966230 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.966191 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:47.966403 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.966241 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4hbp\" (UniqueName: \"kubernetes.io/projected/6046b010-5469-41cc-aa57-80a1c49b345d-kube-api-access-s4hbp\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:47.966403 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.966329 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6046b010-5469-41cc-aa57-80a1c49b345d-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:47.966535 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:47.966522 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.067819 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.067783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.068011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.067847 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4hbp\" (UniqueName: \"kubernetes.io/projected/6046b010-5469-41cc-aa57-80a1c49b345d-kube-api-access-s4hbp\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.068011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.067880 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6046b010-5469-41cc-aa57-80a1c49b345d-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.068011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.067935 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.068204 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:48.068181 2566 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 14 20:26:48.068288 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:48.068268 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-tls podName:6046b010-5469-41cc-aa57-80a1c49b345d nodeName:}" failed. No retries permitted until 2026-07-14 20:26:48.568245968 +0000 UTC m=+275.136361940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-tls") pod "prometheus-operator-64785b6675-xjlkb" (UID: "6046b010-5469-41cc-aa57-80a1c49b345d") : secret "prometheus-operator-tls" not found Jul 14 20:26:48.068700 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.068671 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6046b010-5469-41cc-aa57-80a1c49b345d-metrics-client-ca\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.070753 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.070727 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.079055 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.079027 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4hbp\" (UniqueName: \"kubernetes.io/projected/6046b010-5469-41cc-aa57-80a1c49b345d-kube-api-access-s4hbp\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.572589 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.572545 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.575461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.575428 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/6046b010-5469-41cc-aa57-80a1c49b345d-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-xjlkb\" (UID: \"6046b010-5469-41cc-aa57-80a1c49b345d\") " pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.742580 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.742541 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" Jul 14 20:26:48.883511 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:48.883480 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-xjlkb"] Jul 14 20:26:48.887332 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:48.887302 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6046b010_5469_41cc_aa57_80a1c49b345d.slice/crio-deb5c98d2f281988b4ad3ef85fbb871c9e91852a2564e68b1159791909da9ff7 WatchSource:0}: Error finding container deb5c98d2f281988b4ad3ef85fbb871c9e91852a2564e68b1159791909da9ff7: Status 404 returned error can't find the container with id deb5c98d2f281988b4ad3ef85fbb871c9e91852a2564e68b1159791909da9ff7 Jul 14 20:26:49.088218 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.088136 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-97f6b8b59-dvzt9"] Jul 14 20:26:49.091394 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.091365 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.093775 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.093673 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2kpsj\"" Jul 14 20:26:49.093775 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.093691 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 14 20:26:49.093775 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.093690 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 14 20:26:49.094064 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.093710 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 14 20:26:49.094200 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.094183 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 14 20:26:49.094320 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.094219 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 14 20:26:49.099871 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.099814 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97f6b8b59-dvzt9"] Jul 14 20:26:49.279043 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.279006 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-oauth-serving-cert\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.279240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.279054 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-oauth-config\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.279240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.279135 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gbh9\" (UniqueName: \"kubernetes.io/projected/997352a3-11e7-466e-9172-c80c3faf8ea4-kube-api-access-6gbh9\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.279240 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.279215 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-serving-cert\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.279406 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.279272 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-service-ca\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.279406 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.279368 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-console-config\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.380621 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.380532 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-console-config\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.380621 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.380586 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-oauth-serving-cert\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.380842 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.380626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-oauth-config\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.380842 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.380695 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gbh9\" (UniqueName: \"kubernetes.io/projected/997352a3-11e7-466e-9172-c80c3faf8ea4-kube-api-access-6gbh9\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.380842 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.380725 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-serving-cert\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.380842 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.380761 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-service-ca\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.381423 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.381394 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-console-config\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.381587 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.381542 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-service-ca\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.381587 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.381555 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-oauth-serving-cert\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.383468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.383441 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-oauth-config\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.383714 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.383694 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-serving-cert\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.388924 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.388905 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gbh9\" (UniqueName: \"kubernetes.io/projected/997352a3-11e7-466e-9172-c80c3faf8ea4-kube-api-access-6gbh9\") pod \"console-97f6b8b59-dvzt9\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.403639 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.403599 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:49.549689 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.549659 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-97f6b8b59-dvzt9"] Jul 14 20:26:49.553970 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:49.553934 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod997352a3_11e7_466e_9172_c80c3faf8ea4.slice/crio-78dfe4f1bc6ce2e8985f218435577bfdde9250d32d49909c2809bcd0bcd7203a WatchSource:0}: Error finding container 78dfe4f1bc6ce2e8985f218435577bfdde9250d32d49909c2809bcd0bcd7203a: Status 404 returned error can't find the container with id 78dfe4f1bc6ce2e8985f218435577bfdde9250d32d49909c2809bcd0bcd7203a Jul 14 20:26:49.862879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.862840 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97f6b8b59-dvzt9" event={"ID":"997352a3-11e7-466e-9172-c80c3faf8ea4","Type":"ContainerStarted","Data":"78dfe4f1bc6ce2e8985f218435577bfdde9250d32d49909c2809bcd0bcd7203a"} Jul 14 20:26:49.864323 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:49.864290 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" event={"ID":"6046b010-5469-41cc-aa57-80a1c49b345d","Type":"ContainerStarted","Data":"deb5c98d2f281988b4ad3ef85fbb871c9e91852a2564e68b1159791909da9ff7"} Jul 14 20:26:50.870924 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:50.870885 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" event={"ID":"6046b010-5469-41cc-aa57-80a1c49b345d","Type":"ContainerStarted","Data":"13395130e3635229b6e3b1891cd96ce0d19b6afb90b563e131e35c80839ad721"} Jul 14 20:26:50.871420 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:50.870976 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" event={"ID":"6046b010-5469-41cc-aa57-80a1c49b345d","Type":"ContainerStarted","Data":"9a285c7a9b391caffb8b1f49fcfdc41ad8fb16d4334dcb85b658bb4d6a0fe51f"} Jul 14 20:26:50.889853 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:50.889784 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-xjlkb" podStartSLOduration=2.388060523 podStartE2EDuration="3.889759855s" totalImagesPullingTime="1.501699332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:50.886907169 +0000 UTC m=+277.455023145" watchObservedRunningTime="2026-07-14 20:26:50.889759855 +0000 UTC m=+277.457875834" Jul 14 20:26:53.238452 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.238412 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m7qr9"] Jul 14 20:26:53.244278 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.244250 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z4g55"] Jul 14 20:26:53.244484 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.244455 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.246824 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.246801 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.249913 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.249730 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 14 20:26:53.249913 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.249739 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 14 20:26:53.250381 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.250358 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 14 20:26:53.250548 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.250528 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-zlg2q\"" Jul 14 20:26:53.250624 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.250600 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 14 20:26:53.250747 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.250733 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 14 20:26:53.250816 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.250807 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 14 20:26:53.250948 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.250929 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-62ffc\"" Jul 14 20:26:53.272798 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.272768 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z4g55"] Jul 14 20:26:53.321225 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321188 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.321225 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321231 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-sys\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321257 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904d90a9-f475-4753-b8a5-5949fea88a8f-metrics-client-ca\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321285 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-root\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321337 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321370 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321409 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321447 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-textfile\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.321495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321491 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp5gp\" (UniqueName: \"kubernetes.io/projected/904d90a9-f475-4753-b8a5-5949fea88a8f-kube-api-access-wp5gp\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.321832 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321519 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.322025 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.321993 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-wtmp\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.322140 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.322086 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-tls\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.322140 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.322116 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.322254 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.322152 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.322254 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.322195 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8s5ql\" (UniqueName: \"kubernetes.io/projected/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-api-access-8s5ql\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.422618 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422577 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8s5ql\" (UniqueName: \"kubernetes.io/projected/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-api-access-8s5ql\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.422812 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422660 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.422812 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422721 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-sys\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.422812 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904d90a9-f475-4753-b8a5-5949fea88a8f-metrics-client-ca\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.422812 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422778 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-root\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422807 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-sys\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422810 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422974 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.422993 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-root\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423008 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423092 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-textfile\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423141 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp5gp\" (UniqueName: \"kubernetes.io/projected/904d90a9-f475-4753-b8a5-5949fea88a8f-kube-api-access-wp5gp\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423224 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423172 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-wtmp\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-tls\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423289 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423317 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423475 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-textfile\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423525 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/904d90a9-f475-4753-b8a5-5949fea88a8f-metrics-client-ca\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423601 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423557 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423620 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-wtmp\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.423946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423621 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423946 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:53.423714 2566 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 14 20:26:53.423946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423719 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.423946 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:53.423771 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-tls podName:9cf985c7-74dd-420b-a387-dbb01ab8d6f3 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:53.923753355 +0000 UTC m=+280.491869323 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-z4g55" (UID: "9cf985c7-74dd-420b-a387-dbb01ab8d6f3") : secret "kube-state-metrics-tls" not found Jul 14 20:26:53.423946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.423871 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-accelerators-collector-config\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.426327 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.426283 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-tls\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.426507 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.426486 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.426870 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.426845 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/904d90a9-f475-4753-b8a5-5949fea88a8f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.435631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.435585 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8s5ql\" (UniqueName: \"kubernetes.io/projected/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-api-access-8s5ql\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.435934 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.435906 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp5gp\" (UniqueName: \"kubernetes.io/projected/904d90a9-f475-4753-b8a5-5949fea88a8f-kube-api-access-wp5gp\") pod \"node-exporter-m7qr9\" (UID: \"904d90a9-f475-4753-b8a5-5949fea88a8f\") " pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.558595 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.558556 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m7qr9" Jul 14 20:26:53.687904 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:26:53.687863 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod904d90a9_f475_4753_b8a5_5949fea88a8f.slice/crio-e84429084eb579ff5ddeed8939cd134f0937d30d1cee90d9c0a99e66014b6a4b WatchSource:0}: Error finding container e84429084eb579ff5ddeed8939cd134f0937d30d1cee90d9c0a99e66014b6a4b: Status 404 returned error can't find the container with id e84429084eb579ff5ddeed8939cd134f0937d30d1cee90d9c0a99e66014b6a4b Jul 14 20:26:53.887107 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.886518 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97f6b8b59-dvzt9" event={"ID":"997352a3-11e7-466e-9172-c80c3faf8ea4","Type":"ContainerStarted","Data":"d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851"} Jul 14 20:26:53.888712 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.888683 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7qr9" event={"ID":"904d90a9-f475-4753-b8a5-5949fea88a8f","Type":"ContainerStarted","Data":"e84429084eb579ff5ddeed8939cd134f0937d30d1cee90d9c0a99e66014b6a4b"} Jul 14 20:26:53.905171 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.905116 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-97f6b8b59-dvzt9" podStartSLOduration=0.746705459 podStartE2EDuration="4.905092055s" totalImagesPullingTime="4.158386596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:26:53.90452155 +0000 UTC m=+280.472637563" watchObservedRunningTime="2026-07-14 20:26:53.905092055 +0000 UTC m=+280.473208035" Jul 14 20:26:53.928664 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.928626 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:53.931747 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:53.931717 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9cf985c7-74dd-420b-a387-dbb01ab8d6f3-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-z4g55\" (UID: \"9cf985c7-74dd-420b-a387-dbb01ab8d6f3\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:54.165737 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:54.165647 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" Jul 14 20:26:54.322575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:54.322472 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-z4g55"] Jul 14 20:26:54.897591 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:54.897524 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" event={"ID":"9cf985c7-74dd-420b-a387-dbb01ab8d6f3","Type":"ContainerStarted","Data":"f592674e2aee8c3ee04cc23dd8e5a0519b8537ba96b4b7e91ac0346e3e22e84e"} Jul 14 20:26:55.511647 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:55.511550 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" Jul 14 20:26:55.512124 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:55.511759 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n8snf" podUID="b3ecf8fa-fd1c-472c-8336-706a8f92fab7" Jul 14 20:26:55.903877 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:55.903835 2566 generic.go:356] "Generic (PLEG): container finished" podID="904d90a9-f475-4753-b8a5-5949fea88a8f" containerID="1f429998a8fb7312b8325de2a315e5f506f71d5c76c03fb0f68687294f8fe5d1" exitCode=0 Jul 14 20:26:55.904086 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:55.903889 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7qr9" event={"ID":"904d90a9-f475-4753-b8a5-5949fea88a8f","Type":"ContainerDied","Data":"1f429998a8fb7312b8325de2a315e5f506f71d5c76c03fb0f68687294f8fe5d1"} Jul 14 20:26:55.904086 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:55.903947 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8snf" Jul 14 20:26:55.904086 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:55.903953 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:26:56.215579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.215072 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7565d97bcf-qhf7c"] Jul 14 20:26:56.218452 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.218427 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.221775 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.221752 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-20e37jcugc7ig\"" Jul 14 20:26:56.223185 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.223125 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 14 20:26:56.223185 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.223155 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 14 20:26:56.223359 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.223281 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 14 20:26:56.223419 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.223384 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 14 20:26:56.223492 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.223473 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ggwqg\"" Jul 14 20:26:56.225461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.225440 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 14 20:26:56.248572 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.248536 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7565d97bcf-qhf7c"] Jul 14 20:26:56.255720 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.255673 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.255875 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.255727 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.255875 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.255814 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-tls\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.255875 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.255859 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8867fc3-6a27-4270-af7f-eb4f92287667-metrics-client-ca\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.256040 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.255968 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-grpc-tls\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.256040 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.256026 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.256145 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.256067 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.256145 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.256118 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnxc4\" (UniqueName: \"kubernetes.io/projected/a8867fc3-6a27-4270-af7f-eb4f92287667-kube-api-access-pnxc4\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.356943 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.356907 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnxc4\" (UniqueName: \"kubernetes.io/projected/a8867fc3-6a27-4270-af7f-eb4f92287667-kube-api-access-pnxc4\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357180 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.356987 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357180 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.357027 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357180 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.357091 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-tls\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357180 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.357132 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8867fc3-6a27-4270-af7f-eb4f92287667-metrics-client-ca\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357180 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.357180 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-grpc-tls\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.357216 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.357461 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.357257 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.358120 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.358062 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a8867fc3-6a27-4270-af7f-eb4f92287667-metrics-client-ca\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.360439 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.360382 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.360439 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.360406 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.360640 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.360574 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.361477 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.361442 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-tls\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.361604 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.361541 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-grpc-tls\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.362178 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.361759 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a8867fc3-6a27-4270-af7f-eb4f92287667-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.364379 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.364357 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnxc4\" (UniqueName: \"kubernetes.io/projected/a8867fc3-6a27-4270-af7f-eb4f92287667-kube-api-access-pnxc4\") pod \"thanos-querier-7565d97bcf-qhf7c\" (UID: \"a8867fc3-6a27-4270-af7f-eb4f92287667\") " pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:56.529906 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:56.529816 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:26:57.966413 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:57.966371 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc"] Jul 14 20:26:57.969185 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:57.969163 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:57.973514 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:57.973490 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 14 20:26:57.973648 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:57.973535 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z2x4l\"" Jul 14 20:26:57.981199 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:57.981132 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc"] Jul 14 20:26:58.075323 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.075289 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad7274e1-c673-4113-a95a-e8e37584fb41-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.075498 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.075350 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k645s\" (UniqueName: \"kubernetes.io/projected/ad7274e1-c673-4113-a95a-e8e37584fb41-kube-api-access-k645s\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.176925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.176888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad7274e1-c673-4113-a95a-e8e37584fb41-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.177125 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.176948 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k645s\" (UniqueName: \"kubernetes.io/projected/ad7274e1-c673-4113-a95a-e8e37584fb41-kube-api-access-k645s\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.177125 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:58.177076 2566 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 14 20:26:58.177237 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:26:58.177146 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad7274e1-c673-4113-a95a-e8e37584fb41-monitoring-plugin-cert podName:ad7274e1-c673-4113-a95a-e8e37584fb41 nodeName:}" failed. No retries permitted until 2026-07-14 20:26:58.677127487 +0000 UTC m=+285.245243449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/ad7274e1-c673-4113-a95a-e8e37584fb41-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-2k6rc" (UID: "ad7274e1-c673-4113-a95a-e8e37584fb41") : secret "monitoring-plugin-cert" not found Jul 14 20:26:58.188455 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.188426 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k645s\" (UniqueName: \"kubernetes.io/projected/ad7274e1-c673-4113-a95a-e8e37584fb41-kube-api-access-k645s\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.682353 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.682314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad7274e1-c673-4113-a95a-e8e37584fb41-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.685265 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.685236 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/ad7274e1-c673-4113-a95a-e8e37584fb41-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-2k6rc\" (UID: \"ad7274e1-c673-4113-a95a-e8e37584fb41\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.881768 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.881724 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:26:58.884065 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.884013 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:26:58.884227 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.884074 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:26:58.886826 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.886797 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b3ecf8fa-fd1c-472c-8336-706a8f92fab7-metrics-tls\") pod \"dns-default-n8snf\" (UID: \"b3ecf8fa-fd1c-472c-8336-706a8f92fab7\") " pod="openshift-dns/dns-default-n8snf" Jul 14 20:26:58.886826 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.886812 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"image-registry-fd69b8c94-x4p6t\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:26:58.907184 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.907152 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qv2tt\"" Jul 14 20:26:58.907355 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.907192 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xn5rs\"" Jul 14 20:26:58.915221 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.915190 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:26:58.915363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:58.915334 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n8snf" Jul 14 20:26:59.405600 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:59.404108 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:59.405600 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:59.404882 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:26:59.406176 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:59.406153 2566 patch_prober.go:28] interesting pod/console-97f6b8b59-dvzt9 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" start-of-body= Jul 14 20:26:59.406225 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:26:59.406198 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-97f6b8b59-dvzt9" podUID="997352a3-11e7-466e-9172-c80c3faf8ea4" containerName="console" probeResult="failure" output="Get \"https://10.132.0.20:8443/health\": dial tcp 10.132.0.20:8443: connect: connection refused" Jul 14 20:27:03.418180 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.418015 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fd69b8c94-x4p6t"] Jul 14 20:27:03.459355 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.458274 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n8snf"] Jul 14 20:27:03.498642 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.496347 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc"] Jul 14 20:27:03.498642 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.496451 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7565d97bcf-qhf7c"] Jul 14 20:27:03.938819 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.938773 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" event={"ID":"ad7274e1-c673-4113-a95a-e8e37584fb41","Type":"ContainerStarted","Data":"24f879405599117f380aaae77e8b3db626abf8307223cbef8b8608b23916b8e4"} Jul 14 20:27:03.940686 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.940653 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-d5tww" event={"ID":"c4359acd-2829-4e52-a956-91c0b6865ed0","Type":"ContainerStarted","Data":"8cdbf34848367d0f11670c523da02e28b8ee6af56e92a09080213d5987b03f7c"} Jul 14 20:27:03.941019 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.940948 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:27:03.944566 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.944540 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7qr9" event={"ID":"904d90a9-f475-4753-b8a5-5949fea88a8f","Type":"ContainerStarted","Data":"dd6799c0662fe43af675ea7fb7cac37858c0d5178cb49c6fe8178defc52b137f"} Jul 14 20:27:03.944747 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.944722 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m7qr9" event={"ID":"904d90a9-f475-4753-b8a5-5949fea88a8f","Type":"ContainerStarted","Data":"c9f5bd9efca5ce6b7a41fc8b9e0b81daf377a51e6088c17fec1092e8927ecefb"} Jul 14 20:27:03.946017 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.945989 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"efccefbe5133a997367cb6d1d1176b36ed0bdb21b6d7033d76242a91f364f99e"} Jul 14 20:27:03.948481 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.948454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" event={"ID":"9cf985c7-74dd-420b-a387-dbb01ab8d6f3","Type":"ContainerStarted","Data":"21d7973af5127b712235067f4f5f0c63131c761951fcdb8d716fc342b77d6ec2"} Jul 14 20:27:03.948583 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.948509 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" event={"ID":"9cf985c7-74dd-420b-a387-dbb01ab8d6f3","Type":"ContainerStarted","Data":"806093a00810320adec498f7977fedced7a6d16a4aef8aab2d2c900dea31f259"} Jul 14 20:27:03.948583 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.948541 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" event={"ID":"9cf985c7-74dd-420b-a387-dbb01ab8d6f3","Type":"ContainerStarted","Data":"d0e713d3c6ce3858072e9f9984a58e1885084638d2d5f24d29212f104f2adaf1"} Jul 14 20:27:03.950604 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.950582 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-d5tww" Jul 14 20:27:03.950704 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.950621 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" event={"ID":"b08d123b-73d4-4176-81d7-7672a46c2907","Type":"ContainerStarted","Data":"a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697"} Jul 14 20:27:03.950704 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.950646 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" event={"ID":"b08d123b-73d4-4176-81d7-7672a46c2907","Type":"ContainerStarted","Data":"cb91897227d88f6012d73a8f11494e71c404185d6719b961308a794cf0487d84"} Jul 14 20:27:03.950810 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.950783 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:27:03.952071 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.952050 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8snf" event={"ID":"b3ecf8fa-fd1c-472c-8336-706a8f92fab7","Type":"ContainerStarted","Data":"052616d9fbe970e741862ea586325e078fb9c1bb2878a05e1ab76c1faffdbca7"} Jul 14 20:27:03.956443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.956392 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-d5tww" podStartSLOduration=1.815031971 podStartE2EDuration="19.956377585s" totalImagesPullingTime="18.141345614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:03.956164001 +0000 UTC m=+290.524279980" watchObservedRunningTime="2026-07-14 20:27:03.956377585 +0000 UTC m=+290.524493564" Jul 14 20:27:03.987488 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:03.987417 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-z4g55" podStartSLOduration=2.088969966 podStartE2EDuration="10.987397229s" totalImagesPullingTime="8.898427263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:03.986747281 +0000 UTC m=+290.554863259" watchObservedRunningTime="2026-07-14 20:27:03.987397229 +0000 UTC m=+290.555513207" Jul 14 20:27:04.009925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:04.009866 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m7qr9" podStartSLOduration=9.535091163 podStartE2EDuration="11.009846111s" totalImagesPullingTime="1.397248688s" totalInitContainerRuntime="77.50626ms" isStatefulPod=true podCreationTimestamp="2026-07-14 20:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:04.00387258 +0000 UTC m=+290.571988558" watchObservedRunningTime="2026-07-14 20:27:04.009846111 +0000 UTC m=+290.577962088" Jul 14 20:27:04.028559 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:04.026631 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" podStartSLOduration=268.026608684 podStartE2EDuration="4m28.026608684s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:04.024694653 +0000 UTC m=+290.592810667" watchObservedRunningTime="2026-07-14 20:27:04.026608684 +0000 UTC m=+290.594724664" Jul 14 20:27:05.738535 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.738486 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97f6b8b59-dvzt9"] Jul 14 20:27:05.768727 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.768662 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-647df59f76-lr2g7"] Jul 14 20:27:05.791305 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.791274 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647df59f76-lr2g7"] Jul 14 20:27:05.791493 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.791400 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.807665 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.802984 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 14 20:27:05.860656 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860603 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-service-ca\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.860656 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860655 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-oauth-config\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.860925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860681 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-trusted-ca-bundle\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.860925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860757 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-serving-cert\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.860925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860817 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-config\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.860925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860843 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-oauth-serving-cert\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.860925 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.860865 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snwpr\" (UniqueName: \"kubernetes.io/projected/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-kube-api-access-snwpr\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962374 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-config\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962430 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-oauth-serving-cert\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962464 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snwpr\" (UniqueName: \"kubernetes.io/projected/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-kube-api-access-snwpr\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962501 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-service-ca\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962533 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-oauth-config\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962549 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-trusted-ca-bundle\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.962698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.962616 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-serving-cert\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.964738 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.963999 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-config\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.964738 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.964265 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-service-ca\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.964738 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.964570 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-oauth-serving-cert\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.965481 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.965438 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-trusted-ca-bundle\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.967344 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.967295 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-oauth-config\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.967447 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.967415 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-serving-cert\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:05.971544 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:05.971505 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-snwpr\" (UniqueName: \"kubernetes.io/projected/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-kube-api-access-snwpr\") pod \"console-647df59f76-lr2g7\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:06.110431 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:06.110387 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:07.000003 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:27:06.999924 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-r9mdm" podUID="941f6ef3-8ea0-4657-8b97-91ce535dc8ab" Jul 14 20:27:08.302551 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.302466 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647df59f76-lr2g7"] Jul 14 20:27:08.310657 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:27:08.309817 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3b34e0f_5396_4db6_a0d3_ee989a88fbf1.slice/crio-790d274b06fa036e6813d9f3c15ad9bf34478d7ed9f51e927513cd83ef616212 WatchSource:0}: Error finding container 790d274b06fa036e6813d9f3c15ad9bf34478d7ed9f51e927513cd83ef616212: Status 404 returned error can't find the container with id 790d274b06fa036e6813d9f3c15ad9bf34478d7ed9f51e927513cd83ef616212 Jul 14 20:27:08.989452 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.989412 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"1924bf2294b38d3ed319a26020404ccb9b0be0764d32a75fdf76456d4e9209b6"} Jul 14 20:27:08.989645 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.989507 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"24bc448858ce8f9fef4532a3b7c53c8cc187128b70540d52cab1d4d95e9cdc24"} Jul 14 20:27:08.989645 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.989551 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"68c074c8f45b14f020baa944990ca5e4fd91e3910daf67af047feb097c7f2dc8"} Jul 14 20:27:08.991394 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.991360 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647df59f76-lr2g7" event={"ID":"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1","Type":"ContainerStarted","Data":"aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7"} Jul 14 20:27:08.991527 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.991417 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647df59f76-lr2g7" event={"ID":"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1","Type":"ContainerStarted","Data":"790d274b06fa036e6813d9f3c15ad9bf34478d7ed9f51e927513cd83ef616212"} Jul 14 20:27:08.993536 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.993501 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8snf" event={"ID":"b3ecf8fa-fd1c-472c-8336-706a8f92fab7","Type":"ContainerStarted","Data":"0093a1c22f6e89e2a623a5638a05e4e88c89784d68a1996e81e9c6b9711a9c14"} Jul 14 20:27:08.993679 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.993556 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n8snf" event={"ID":"b3ecf8fa-fd1c-472c-8336-706a8f92fab7","Type":"ContainerStarted","Data":"4008a66e6b8da7fd712dea487312ce1cb9f27ad3cca44a662a790d38d4294ea5"} Jul 14 20:27:08.993679 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.993588 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n8snf" Jul 14 20:27:08.995387 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.995332 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" event={"ID":"ad7274e1-c673-4113-a95a-e8e37584fb41","Type":"ContainerStarted","Data":"d473617d40ae758ceef10b0958432ae9c30a1cfaac44433058c076a017de1177"} Jul 14 20:27:08.995582 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:08.995551 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:27:09.001017 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:09.000947 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" Jul 14 20:27:09.042235 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:09.042157 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-647df59f76-lr2g7" podStartSLOduration=4.04213994 podStartE2EDuration="4.04213994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:09.02287003 +0000 UTC m=+295.590986018" watchObservedRunningTime="2026-07-14 20:27:09.04213994 +0000 UTC m=+295.610255918" Jul 14 20:27:09.042433 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:09.042337 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-2k6rc" podStartSLOduration=7.454287872 podStartE2EDuration="12.042301292s" totalImagesPullingTime="4.58801342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:09.039333767 +0000 UTC m=+295.607449870" watchObservedRunningTime="2026-07-14 20:27:09.042301292 +0000 UTC m=+295.610417271" Jul 14 20:27:10.005736 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:10.005701 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"a26bf8712930f795893cc17c79bcf0011bc914464abfac56c92379828ef7a1f1"} Jul 14 20:27:11.014724 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:11.014676 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"0de18091adca5e238134d8264a4a2ef5650a01edafb1198b75270abc398bdda2"} Jul 14 20:27:11.015324 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:11.014770 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" event={"ID":"a8867fc3-6a27-4270-af7f-eb4f92287667","Type":"ContainerStarted","Data":"86dac7dfa274573ff19e27b04470c9324129fb633bdf2568edfe9785f12ecb8c"} Jul 14 20:27:11.015324 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:11.014974 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:27:11.040631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:11.040565 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" podStartSLOduration=9.142459419 podStartE2EDuration="15.040544285s" totalImagesPullingTime="5.898084866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:26:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:11.039246775 +0000 UTC m=+297.607362763" watchObservedRunningTime="2026-07-14 20:27:11.040544285 +0000 UTC m=+297.608660264" Jul 14 20:27:11.041844 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:11.041806 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n8snf" podStartSLOduration=258.41765949 podStartE2EDuration="4m23.041794596s" totalImagesPullingTime="4.624135106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:27:09.068150974 +0000 UTC m=+295.636266951" watchObservedRunningTime="2026-07-14 20:27:11.041794596 +0000 UTC m=+297.609910550" Jul 14 20:27:13.847150 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:13.847121 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:27:13.848170 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:13.848143 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:27:13.853794 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:13.853770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:27:13.854938 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:13.854920 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:27:13.858130 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:13.858116 2566 kubelet.go:1648] "Image garbage collection succeeded" Jul 14 20:27:16.111019 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:16.110953 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:16.130023 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:16.111051 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:16.130023 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:16.112288 2566 patch_prober.go:28] interesting pod/console-647df59f76-lr2g7 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" start-of-body= Jul 14 20:27:16.130023 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:16.112325 2566 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-647df59f76-lr2g7" podUID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" containerName="console" probeResult="failure" output="Get \"https://10.132.0.24:8443/health\": dial tcp 10.132.0.24:8443: connect: connection refused" Jul 14 20:27:17.025477 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:17.025450 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7565d97bcf-qhf7c" Jul 14 20:27:18.920192 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:18.920153 2566 patch_prober.go:28] interesting pod/image-registry-fd69b8c94-x4p6t container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 14 20:27:18.920553 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:18.920219 2566 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 14 20:27:18.997018 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:18.996986 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:27:19.018549 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:19.018523 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n8snf" Jul 14 20:27:24.972176 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:24.972145 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:27:26.114641 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:26.114608 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:26.118337 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:26.118317 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:27:30.767530 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:30.767463 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-97f6b8b59-dvzt9" podUID="997352a3-11e7-466e-9172-c80c3faf8ea4" containerName="console" containerID="cri-o://d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851" gracePeriod=15 Jul 14 20:27:31.043850 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.043773 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:27:31.099183 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.099147 2566 generic.go:356] "Generic (PLEG): container finished" podID="997352a3-11e7-466e-9172-c80c3faf8ea4" containerID="d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851" exitCode=0 Jul 14 20:27:31.099347 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.099192 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-97f6b8b59-dvzt9" Jul 14 20:27:31.099347 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.099206 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97f6b8b59-dvzt9" event={"ID":"997352a3-11e7-466e-9172-c80c3faf8ea4","Type":"ContainerDied","Data":"d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851"} Jul 14 20:27:31.099347 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.099262 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-97f6b8b59-dvzt9" event={"ID":"997352a3-11e7-466e-9172-c80c3faf8ea4","Type":"ContainerDied","Data":"78dfe4f1bc6ce2e8985f218435577bfdde9250d32d49909c2809bcd0bcd7203a"} Jul 14 20:27:31.099347 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.099285 2566 scope.go:117] "RemoveContainer" containerID="d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851" Jul 14 20:27:31.107318 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107301 2566 scope.go:117] "RemoveContainer" containerID="d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851" Jul 14 20:27:31.107418 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107401 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-oauth-config\") pod \"997352a3-11e7-466e-9172-c80c3faf8ea4\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " Jul 14 20:27:31.107472 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107459 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-service-ca\") pod \"997352a3-11e7-466e-9172-c80c3faf8ea4\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " Jul 14 20:27:31.107525 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107514 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-console-config\") pod \"997352a3-11e7-466e-9172-c80c3faf8ea4\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " Jul 14 20:27:31.107564 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107540 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-oauth-serving-cert\") pod \"997352a3-11e7-466e-9172-c80c3faf8ea4\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " Jul 14 20:27:31.107608 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107563 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gbh9\" (UniqueName: \"kubernetes.io/projected/997352a3-11e7-466e-9172-c80c3faf8ea4-kube-api-access-6gbh9\") pod \"997352a3-11e7-466e-9172-c80c3faf8ea4\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " Jul 14 20:27:31.107608 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107590 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-serving-cert\") pod \"997352a3-11e7-466e-9172-c80c3faf8ea4\" (UID: \"997352a3-11e7-466e-9172-c80c3faf8ea4\") " Jul 14 20:27:31.107831 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:27:31.107690 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851\": container with ID starting with d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851 not found: ID does not exist" containerID="d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851" Jul 14 20:27:31.107831 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107739 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851"} err="failed to get container status \"d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851\": rpc error: code = NotFound desc = could not find container \"d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851\": container with ID starting with d14bd90f93ea7f76fdf3faa3b3fe33a1be77c08aeb1566276d25af46897fd851 not found: ID does not exist" Jul 14 20:27:31.107946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107908 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-service-ca" (OuterVolumeSpecName: "service-ca") pod "997352a3-11e7-466e-9172-c80c3faf8ea4" (UID: "997352a3-11e7-466e-9172-c80c3faf8ea4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:27:31.107946 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.107919 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "997352a3-11e7-466e-9172-c80c3faf8ea4" (UID: "997352a3-11e7-466e-9172-c80c3faf8ea4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:27:31.108055 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.108000 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-console-config" (OuterVolumeSpecName: "console-config") pod "997352a3-11e7-466e-9172-c80c3faf8ea4" (UID: "997352a3-11e7-466e-9172-c80c3faf8ea4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:27:31.109623 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.109599 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "997352a3-11e7-466e-9172-c80c3faf8ea4" (UID: "997352a3-11e7-466e-9172-c80c3faf8ea4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:27:31.109737 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.109673 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "997352a3-11e7-466e-9172-c80c3faf8ea4" (UID: "997352a3-11e7-466e-9172-c80c3faf8ea4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:27:31.109797 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.109781 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/997352a3-11e7-466e-9172-c80c3faf8ea4-kube-api-access-6gbh9" (OuterVolumeSpecName: "kube-api-access-6gbh9") pod "997352a3-11e7-466e-9172-c80c3faf8ea4" (UID: "997352a3-11e7-466e-9172-c80c3faf8ea4"). InnerVolumeSpecName "kube-api-access-6gbh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:27:31.209251 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.209216 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-oauth-config\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:27:31.209251 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.209247 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-service-ca\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:27:31.209457 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.209263 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-console-config\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:27:31.209457 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.209272 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/997352a3-11e7-466e-9172-c80c3faf8ea4-oauth-serving-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:27:31.209457 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.209283 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gbh9\" (UniqueName: \"kubernetes.io/projected/997352a3-11e7-466e-9172-c80c3faf8ea4-kube-api-access-6gbh9\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:27:31.209457 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.209293 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/997352a3-11e7-466e-9172-c80c3faf8ea4-console-serving-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:27:31.420016 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.419974 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-97f6b8b59-dvzt9"] Jul 14 20:27:31.421332 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:31.421310 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-97f6b8b59-dvzt9"] Jul 14 20:27:32.002798 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:32.002768 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="997352a3-11e7-466e-9172-c80c3faf8ea4" path="/var/lib/kubelet/pods/997352a3-11e7-466e-9172-c80c3faf8ea4/volumes" Jul 14 20:27:35.159969 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:35.159929 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fd69b8c94-x4p6t"] Jul 14 20:27:37.129736 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:37.129702 2566 generic.go:356] "Generic (PLEG): container finished" podID="d1f56ce6-a776-4d87-bac9-651b9fbee27c" containerID="0ff15838e12b56e12da1d610133f1b880d1f8a6c7de8f1b0b498b7e42cfeaa6b" exitCode=0 Jul 14 20:27:37.130173 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:37.129747 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" event={"ID":"d1f56ce6-a776-4d87-bac9-651b9fbee27c","Type":"ContainerDied","Data":"0ff15838e12b56e12da1d610133f1b880d1f8a6c7de8f1b0b498b7e42cfeaa6b"} Jul 14 20:27:37.130173 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:37.130073 2566 scope.go:117] "RemoveContainer" containerID="0ff15838e12b56e12da1d610133f1b880d1f8a6c7de8f1b0b498b7e42cfeaa6b" Jul 14 20:27:38.136872 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:38.136833 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-wg8n5" event={"ID":"d1f56ce6-a776-4d87-bac9-651b9fbee27c","Type":"ContainerStarted","Data":"83f86c4349831142cb623f8ef146e577c9a01a94af935a9331b5e7ddbd664ce7"} Jul 14 20:27:47.377139 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:47.377109 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78b47967f6-8lb62_5f9692de-108f-4a8c-a734-a8fb6014a7cc/router/0.log" Jul 14 20:27:47.383210 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:27:47.383191 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7kz89_84644784-a141-4dda-b4e1-089ed1b2e26b/serve-healthcheck-canary/0.log" Jul 14 20:28:00.180019 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:00.179933 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" containerName="registry" containerID="cri-o://a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697" gracePeriod=30 Jul 14 20:28:01.482203 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.482176 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:28:01.586190 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586157 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-image-registry-private-configuration\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586215 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-trusted-ca\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586232 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-bound-sa-token\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586270 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586292 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-registry-certificates\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586325 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-js9d5\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-kube-api-access-js9d5\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586622 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586371 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b08d123b-73d4-4176-81d7-7672a46c2907-ca-trust-extracted\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586622 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586420 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-installation-pull-secrets\") pod \"b08d123b-73d4-4176-81d7-7672a46c2907\" (UID: \"b08d123b-73d4-4176-81d7-7672a46c2907\") " Jul 14 20:28:01.586734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.586711 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:28:01.587078 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.587043 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:28:01.588867 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.588835 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:28:01.589007 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.588909 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:28:01.589007 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.588918 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-kube-api-access-js9d5" (OuterVolumeSpecName: "kube-api-access-js9d5") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "kube-api-access-js9d5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:28:01.589007 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.588987 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:28:01.589007 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.589004 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:28:01.596115 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.596086 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b08d123b-73d4-4176-81d7-7672a46c2907-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b08d123b-73d4-4176-81d7-7672a46c2907" (UID: "b08d123b-73d4-4176-81d7-7672a46c2907"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:28:01.687947 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.687909 2566 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b08d123b-73d4-4176-81d7-7672a46c2907-ca-trust-extracted\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.687947 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.687940 2566 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-installation-pull-secrets\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.687947 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.687951 2566 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b08d123b-73d4-4176-81d7-7672a46c2907-image-registry-private-configuration\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.688198 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.687985 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-trusted-ca\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.688198 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.687994 2566 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-bound-sa-token\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.688198 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.688001 2566 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-registry-tls\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.688198 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.688009 2566 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b08d123b-73d4-4176-81d7-7672a46c2907-registry-certificates\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:01.688198 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:01.688016 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-js9d5\" (UniqueName: \"kubernetes.io/projected/b08d123b-73d4-4176-81d7-7672a46c2907-kube-api-access-js9d5\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:02.243301 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.243265 2566 generic.go:356] "Generic (PLEG): container finished" podID="b08d123b-73d4-4176-81d7-7672a46c2907" containerID="a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697" exitCode=0 Jul 14 20:28:02.243468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.243311 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" Jul 14 20:28:02.243468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.243326 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" event={"ID":"b08d123b-73d4-4176-81d7-7672a46c2907","Type":"ContainerDied","Data":"a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697"} Jul 14 20:28:02.243468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.243375 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fd69b8c94-x4p6t" event={"ID":"b08d123b-73d4-4176-81d7-7672a46c2907","Type":"ContainerDied","Data":"cb91897227d88f6012d73a8f11494e71c404185d6719b961308a794cf0487d84"} Jul 14 20:28:02.243468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.243402 2566 scope.go:117] "RemoveContainer" containerID="a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697" Jul 14 20:28:02.254059 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.253921 2566 scope.go:117] "RemoveContainer" containerID="a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697" Jul 14 20:28:02.254336 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:28:02.254307 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697\": container with ID starting with a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697 not found: ID does not exist" containerID="a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697" Jul 14 20:28:02.254397 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.254346 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697"} err="failed to get container status \"a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697\": rpc error: code = NotFound desc = could not find container \"a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697\": container with ID starting with a62260f90394dc5967bbe091b820aab9ff1dc9d2813a07026414100a83e23697 not found: ID does not exist" Jul 14 20:28:02.258626 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.258600 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fd69b8c94-x4p6t"] Jul 14 20:28:02.262200 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:02.262151 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fd69b8c94-x4p6t"] Jul 14 20:28:04.003302 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:04.003273 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" path="/var/lib/kubelet/pods/b08d123b-73d4-4176-81d7-7672a46c2907/volumes" Jul 14 20:28:14.999999 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:14.999948 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 20:28:15.000379 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.000299 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="997352a3-11e7-466e-9172-c80c3faf8ea4" containerName="console" Jul 14 20:28:15.000379 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.000312 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="997352a3-11e7-466e-9172-c80c3faf8ea4" containerName="console" Jul 14 20:28:15.000379 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.000327 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" containerName="registry" Jul 14 20:28:15.000379 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.000332 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" containerName="registry" Jul 14 20:28:15.000504 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.000389 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="997352a3-11e7-466e-9172-c80c3faf8ea4" containerName="console" Jul 14 20:28:15.000504 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.000399 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b08d123b-73d4-4176-81d7-7672a46c2907" containerName="registry" Jul 14 20:28:15.004285 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.004263 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.008087 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008058 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 14 20:28:15.008236 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008083 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 14 20:28:15.008236 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008188 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 14 20:28:15.008236 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008188 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kslhj\"" Jul 14 20:28:15.008701 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008548 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 14 20:28:15.008701 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008569 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 14 20:28:15.008701 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008556 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 14 20:28:15.008701 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008605 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 14 20:28:15.008701 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.008631 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 14 20:28:15.012785 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.012763 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 14 20:28:15.019489 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.019468 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 20:28:15.098068 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098028 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9df7b39-89b6-4b83-b006-f6b437c85fa7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098081 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098103 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098123 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9df7b39-89b6-4b83-b006-f6b437c85fa7-config-out\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098142 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098157 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsqzh\" (UniqueName: \"kubernetes.io/projected/a9df7b39-89b6-4b83-b006-f6b437c85fa7-kube-api-access-lsqzh\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098259 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098243 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098309 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9df7b39-89b6-4b83-b006-f6b437c85fa7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098327 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9df7b39-89b6-4b83-b006-f6b437c85fa7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098347 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098365 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9df7b39-89b6-4b83-b006-f6b437c85fa7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.098490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.098410 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-web-config\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199267 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199231 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199267 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199270 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9df7b39-89b6-4b83-b006-f6b437c85fa7-config-out\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199295 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199314 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsqzh\" (UniqueName: \"kubernetes.io/projected/a9df7b39-89b6-4b83-b006-f6b437c85fa7-kube-api-access-lsqzh\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199334 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199395 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9df7b39-89b6-4b83-b006-f6b437c85fa7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199497 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199420 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9df7b39-89b6-4b83-b006-f6b437c85fa7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199756 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199552 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199756 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199600 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9df7b39-89b6-4b83-b006-f6b437c85fa7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199756 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199630 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199756 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199664 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-web-config\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.199756 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199709 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9df7b39-89b6-4b83-b006-f6b437c85fa7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.200038 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199776 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.200038 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.199952 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a9df7b39-89b6-4b83-b006-f6b437c85fa7-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.200405 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.200379 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a9df7b39-89b6-4b83-b006-f6b437c85fa7-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.201489 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.201464 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a9df7b39-89b6-4b83-b006-f6b437c85fa7-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202260 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202127 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a9df7b39-89b6-4b83-b006-f6b437c85fa7-config-out\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202467 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202411 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202562 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202479 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202562 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202500 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202562 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202518 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202714 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202692 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.202834 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.202819 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-web-config\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.204189 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.204170 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a9df7b39-89b6-4b83-b006-f6b437c85fa7-config-volume\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.204572 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.204552 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a9df7b39-89b6-4b83-b006-f6b437c85fa7-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.207393 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.207372 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsqzh\" (UniqueName: \"kubernetes.io/projected/a9df7b39-89b6-4b83-b006-f6b437c85fa7-kube-api-access-lsqzh\") pod \"alertmanager-main-0\" (UID: \"a9df7b39-89b6-4b83-b006-f6b437c85fa7\") " pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.315696 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.315656 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 14 20:28:15.465726 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.465702 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 14 20:28:15.468577 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:28:15.468546 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9df7b39_89b6_4b83_b006_f6b437c85fa7.slice/crio-8d52958464e0b1f71a6ed82aaa0c4697314264e0575085c34fe63649094677a2 WatchSource:0}: Error finding container 8d52958464e0b1f71a6ed82aaa0c4697314264e0575085c34fe63649094677a2: Status 404 returned error can't find the container with id 8d52958464e0b1f71a6ed82aaa0c4697314264e0575085c34fe63649094677a2 Jul 14 20:28:15.470950 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:15.470934 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:28:16.300732 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:16.300698 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"8d52958464e0b1f71a6ed82aaa0c4697314264e0575085c34fe63649094677a2"} Jul 14 20:28:17.305936 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:17.305898 2566 generic.go:356] "Generic (PLEG): container finished" podID="a9df7b39-89b6-4b83-b006-f6b437c85fa7" containerID="3bf5931117f122538c652844211fdee16fd8756d49100ebb47c69a7b083ba63c" exitCode=0 Jul 14 20:28:17.306351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:17.305991 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerDied","Data":"3bf5931117f122538c652844211fdee16fd8756d49100ebb47c69a7b083ba63c"} Jul 14 20:28:19.316465 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:19.316436 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"40774c3b1ced3e83cd4c12603eec67e402358c78e55f2b5c8c6252ceac010290"} Jul 14 20:28:19.316796 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:19.316505 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"824b728dd0676ef299d069feaaf73a61486eee940a302abc0f4fcbc87e5b4793"} Jul 14 20:28:19.316796 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:19.316535 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"f2e24784f93162351c163f402cad66d217988f10c3a0d6b9d2f8968d075e6718"} Jul 14 20:28:20.324025 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:20.323982 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"e064b090558bb105adecbcae0f14975e60f60c509e1d544a3b007e4a31f5f069"} Jul 14 20:28:20.324425 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:20.324060 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"b1bcf6168231ddc4d33437c242a8eaa7a54dddaaaa093d814c8c9b298d8810a8"} Jul 14 20:28:20.324425 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:20.324111 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a9df7b39-89b6-4b83-b006-f6b437c85fa7","Type":"ContainerStarted","Data":"bbcdd386788d178d70849eb3d3b305e010885bbd94727cb980c8dad5bb7453c0"} Jul 14 20:28:20.350715 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:20.350661 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.318404078 podStartE2EDuration="6.35064347s" totalImagesPullingTime="3.016260149s" totalInitContainerRuntime="15.979243ms" isStatefulPod=false podCreationTimestamp="2026-07-14 20:28:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:28:20.348848151 +0000 UTC m=+366.916964128" watchObservedRunningTime="2026-07-14 20:28:20.35064347 +0000 UTC m=+366.918759535" Jul 14 20:28:21.591122 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.591084 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b4c8c9c88-2ddnk"] Jul 14 20:28:21.594070 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.593993 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.606087 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.606058 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4c8c9c88-2ddnk"] Jul 14 20:28:21.658742 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.658710 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-service-ca\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.658742 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.658747 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-console-config\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.658927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.658769 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-trusted-ca-bundle\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.658927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.658853 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-oauth-serving-cert\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.658927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.658890 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-serving-cert\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.659052 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.658974 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-oauth-config\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.659052 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.659007 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5hjw\" (UniqueName: \"kubernetes.io/projected/1742db5c-321a-4cbf-a07b-332e298f2da7-kube-api-access-j5hjw\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759556 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759517 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-trusted-ca-bundle\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759741 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759564 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-oauth-serving-cert\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759741 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759587 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-serving-cert\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759741 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759635 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-oauth-config\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759741 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759667 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5hjw\" (UniqueName: \"kubernetes.io/projected/1742db5c-321a-4cbf-a07b-332e298f2da7-kube-api-access-j5hjw\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759952 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759799 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-service-ca\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.759952 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.759857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-console-config\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.760456 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.760432 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-service-ca\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.760456 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.760444 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-oauth-serving-cert\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.760635 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.760544 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-console-config\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.760635 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.760544 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-trusted-ca-bundle\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.762190 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.762160 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-oauth-config\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.762290 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.762273 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-serving-cert\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.767361 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.767343 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5hjw\" (UniqueName: \"kubernetes.io/projected/1742db5c-321a-4cbf-a07b-332e298f2da7-kube-api-access-j5hjw\") pod \"console-b4c8c9c88-2ddnk\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:21.910859 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:21.910746 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:22.043675 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:22.043638 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b4c8c9c88-2ddnk"] Jul 14 20:28:22.047972 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:28:22.047925 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1742db5c_321a_4cbf_a07b_332e298f2da7.slice/crio-8d333940e8abc76bd446ff97db9afea66725db88362b788eeb2e70e69dbd50be WatchSource:0}: Error finding container 8d333940e8abc76bd446ff97db9afea66725db88362b788eeb2e70e69dbd50be: Status 404 returned error can't find the container with id 8d333940e8abc76bd446ff97db9afea66725db88362b788eeb2e70e69dbd50be Jul 14 20:28:22.334944 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:22.334816 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4c8c9c88-2ddnk" event={"ID":"1742db5c-321a-4cbf-a07b-332e298f2da7","Type":"ContainerStarted","Data":"9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06"} Jul 14 20:28:22.334944 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:22.334884 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4c8c9c88-2ddnk" event={"ID":"1742db5c-321a-4cbf-a07b-332e298f2da7","Type":"ContainerStarted","Data":"8d333940e8abc76bd446ff97db9afea66725db88362b788eeb2e70e69dbd50be"} Jul 14 20:28:22.354377 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:22.354327 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b4c8c9c88-2ddnk" podStartSLOduration=1.354307936 podStartE2EDuration="1.354307936s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:28:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:28:22.353902618 +0000 UTC m=+368.922018606" watchObservedRunningTime="2026-07-14 20:28:22.354307936 +0000 UTC m=+368.922423913" Jul 14 20:28:27.817502 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:27.817446 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:28:27.819716 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:27.819690 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/941f6ef3-8ea0-4657-8b97-91ce535dc8ab-metrics-certs\") pod \"network-metrics-daemon-r9mdm\" (UID: \"941f6ef3-8ea0-4657-8b97-91ce535dc8ab\") " pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:28:28.000315 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:28.000289 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5hghx\"" Jul 14 20:28:28.008896 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:28.008863 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r9mdm" Jul 14 20:28:28.139507 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:28.139417 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r9mdm"] Jul 14 20:28:28.142245 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:28:28.142218 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941f6ef3_8ea0_4657_8b97_91ce535dc8ab.slice/crio-d534816736c6d20f12a9563ac5e7596fd8ff98f6731d27d45a70c62ca135388c WatchSource:0}: Error finding container d534816736c6d20f12a9563ac5e7596fd8ff98f6731d27d45a70c62ca135388c: Status 404 returned error can't find the container with id d534816736c6d20f12a9563ac5e7596fd8ff98f6731d27d45a70c62ca135388c Jul 14 20:28:28.360314 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:28.360218 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r9mdm" event={"ID":"941f6ef3-8ea0-4657-8b97-91ce535dc8ab","Type":"ContainerStarted","Data":"d534816736c6d20f12a9563ac5e7596fd8ff98f6731d27d45a70c62ca135388c"} Jul 14 20:28:30.371569 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:30.371528 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r9mdm" event={"ID":"941f6ef3-8ea0-4657-8b97-91ce535dc8ab","Type":"ContainerStarted","Data":"ceede13f0f0d8441efebc3efbd6010e92b45b30e22e6f8a5938f85af3074dbfe"} Jul 14 20:28:30.371942 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:30.371592 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r9mdm" event={"ID":"941f6ef3-8ea0-4657-8b97-91ce535dc8ab","Type":"ContainerStarted","Data":"3a55f828caec8de679e7dafc72ac70fb072b4e7638d023072b46211a4d37fed1"} Jul 14 20:28:30.387779 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:30.387735 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r9mdm" podStartSLOduration=374.955190199 podStartE2EDuration="6m16.387720601s" totalImagesPullingTime="1.432530402s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:22:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:28:30.386287342 +0000 UTC m=+376.954403319" watchObservedRunningTime="2026-07-14 20:28:30.387720601 +0000 UTC m=+376.955836577" Jul 14 20:28:31.911257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:31.911222 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:31.911622 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:31.911281 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:31.916154 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:31.916132 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:32.383571 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:32.383543 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:28:32.430617 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:32.430574 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647df59f76-lr2g7"] Jul 14 20:28:57.455246 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.455188 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-647df59f76-lr2g7" podUID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" containerName="console" containerID="cri-o://aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7" gracePeriod=15 Jul 14 20:28:57.710027 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.709945 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:28:57.767612 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767577 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-serving-cert\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.767786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767630 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-oauth-serving-cert\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.767786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767652 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-service-ca\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.767786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767684 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-config\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.767786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767702 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-snwpr\" (UniqueName: \"kubernetes.io/projected/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-kube-api-access-snwpr\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.767786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767759 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-oauth-config\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.768170 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.767795 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-trusted-ca-bundle\") pod \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\" (UID: \"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1\") " Jul 14 20:28:57.768170 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.768092 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-config" (OuterVolumeSpecName: "console-config") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:28:57.768170 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.768145 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:28:57.768327 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.768162 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:28:57.768384 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.768337 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:28:57.769785 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.769765 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:28:57.769879 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.769829 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-kube-api-access-snwpr" (OuterVolumeSpecName: "kube-api-access-snwpr") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "kube-api-access-snwpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:28:57.769939 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.769921 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" (UID: "b3b34e0f-5396-4db6-a0d3-ee989a88fbf1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:28:57.868521 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868482 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-serving-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:57.868521 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868515 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-oauth-serving-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:57.868521 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868525 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-service-ca\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:57.868521 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868534 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-config\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:57.868772 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868542 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-snwpr\" (UniqueName: \"kubernetes.io/projected/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-kube-api-access-snwpr\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:57.868772 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868552 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-console-oauth-config\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:57.868772 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:57.868562 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1-trusted-ca-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:28:58.487640 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.487608 2566 generic.go:356] "Generic (PLEG): container finished" podID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" containerID="aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7" exitCode=0 Jul 14 20:28:58.488063 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.487652 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647df59f76-lr2g7" Jul 14 20:28:58.488063 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.487697 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647df59f76-lr2g7" event={"ID":"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1","Type":"ContainerDied","Data":"aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7"} Jul 14 20:28:58.488063 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.487752 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647df59f76-lr2g7" event={"ID":"b3b34e0f-5396-4db6-a0d3-ee989a88fbf1","Type":"ContainerDied","Data":"790d274b06fa036e6813d9f3c15ad9bf34478d7ed9f51e927513cd83ef616212"} Jul 14 20:28:58.488063 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.487779 2566 scope.go:117] "RemoveContainer" containerID="aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7" Jul 14 20:28:58.496320 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.496303 2566 scope.go:117] "RemoveContainer" containerID="aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7" Jul 14 20:28:58.496573 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:28:58.496555 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7\": container with ID starting with aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7 not found: ID does not exist" containerID="aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7" Jul 14 20:28:58.496615 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.496583 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7"} err="failed to get container status \"aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7\": rpc error: code = NotFound desc = could not find container \"aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7\": container with ID starting with aa4f78506a1776a651c4b3558012d36956af8824646936909798b8c6b31983f7 not found: ID does not exist" Jul 14 20:28:58.502608 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.502587 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647df59f76-lr2g7"] Jul 14 20:28:58.506218 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:28:58.506196 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-647df59f76-lr2g7"] Jul 14 20:29:00.002631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:00.002600 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" path="/var/lib/kubelet/pods/b3b34e0f-5396-4db6-a0d3-ee989a88fbf1/volumes" Jul 14 20:29:15.332265 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.332231 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q"] Jul 14 20:29:15.332620 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.332555 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" containerName="console" Jul 14 20:29:15.332620 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.332566 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" containerName="console" Jul 14 20:29:15.332620 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.332619 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3b34e0f-5396-4db6-a0d3-ee989a88fbf1" containerName="console" Jul 14 20:29:15.336686 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.336668 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.338903 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.338883 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 20:29:15.338903 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.338895 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfr7t\"" Jul 14 20:29:15.339365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.339352 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 20:29:15.344435 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.344414 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q"] Jul 14 20:29:15.407356 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.407319 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.407554 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.407381 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.407554 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.407439 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5lvb\" (UniqueName: \"kubernetes.io/projected/ab52059a-a8b5-42fd-8c73-c93c29438a9f-kube-api-access-x5lvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.508688 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.508653 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.508847 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.508713 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.508847 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.508783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5lvb\" (UniqueName: \"kubernetes.io/projected/ab52059a-a8b5-42fd-8c73-c93c29438a9f-kube-api-access-x5lvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.509179 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.509155 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.509314 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.509166 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.517350 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.517328 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5lvb\" (UniqueName: \"kubernetes.io/projected/ab52059a-a8b5-42fd-8c73-c93c29438a9f-kube-api-access-x5lvb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.646611 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.646517 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:15.774306 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:15.774163 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q"] Jul 14 20:29:15.776842 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:29:15.776815 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab52059a_a8b5_42fd_8c73_c93c29438a9f.slice/crio-6a14315ebefda533c762c1ca6254c8139c653cc2af4aa45ac31a6948bdc9bbc2 WatchSource:0}: Error finding container 6a14315ebefda533c762c1ca6254c8139c653cc2af4aa45ac31a6948bdc9bbc2: Status 404 returned error can't find the container with id 6a14315ebefda533c762c1ca6254c8139c653cc2af4aa45ac31a6948bdc9bbc2 Jul 14 20:29:16.561232 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:16.561194 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" event={"ID":"ab52059a-a8b5-42fd-8c73-c93c29438a9f","Type":"ContainerStarted","Data":"6a14315ebefda533c762c1ca6254c8139c653cc2af4aa45ac31a6948bdc9bbc2"} Jul 14 20:29:23.595620 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:23.595579 2566 generic.go:356] "Generic (PLEG): container finished" podID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerID="449b3247500c9b01195d33769252b2d52107a76f827add003d476c1eb035d57a" exitCode=0 Jul 14 20:29:23.596032 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:23.595652 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" event={"ID":"ab52059a-a8b5-42fd-8c73-c93c29438a9f","Type":"ContainerDied","Data":"449b3247500c9b01195d33769252b2d52107a76f827add003d476c1eb035d57a"} Jul 14 20:29:26.611790 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:26.611753 2566 generic.go:356] "Generic (PLEG): container finished" podID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerID="ef102eb70eae8aac2f96b5fb40733b8d9a00a876f48f906fafc20177659e5cff" exitCode=0 Jul 14 20:29:26.612174 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:26.611841 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" event={"ID":"ab52059a-a8b5-42fd-8c73-c93c29438a9f","Type":"ContainerDied","Data":"ef102eb70eae8aac2f96b5fb40733b8d9a00a876f48f906fafc20177659e5cff"} Jul 14 20:29:34.652425 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:34.652389 2566 generic.go:356] "Generic (PLEG): container finished" podID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerID="754dd54f596c87c4e772d7ff47ebee89dc066dc3f2ae0a11dc18f22b10abdf8a" exitCode=0 Jul 14 20:29:34.652828 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:34.652434 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" event={"ID":"ab52059a-a8b5-42fd-8c73-c93c29438a9f","Type":"ContainerDied","Data":"754dd54f596c87c4e772d7ff47ebee89dc066dc3f2ae0a11dc18f22b10abdf8a"} Jul 14 20:29:35.785137 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.785112 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:35.895255 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.895212 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5lvb\" (UniqueName: \"kubernetes.io/projected/ab52059a-a8b5-42fd-8c73-c93c29438a9f-kube-api-access-x5lvb\") pod \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " Jul 14 20:29:35.895447 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.895327 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-util\") pod \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " Jul 14 20:29:35.895447 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.895360 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-bundle\") pod \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\" (UID: \"ab52059a-a8b5-42fd-8c73-c93c29438a9f\") " Jul 14 20:29:35.896085 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.896056 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-bundle" (OuterVolumeSpecName: "bundle") pod "ab52059a-a8b5-42fd-8c73-c93c29438a9f" (UID: "ab52059a-a8b5-42fd-8c73-c93c29438a9f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:29:35.897562 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.897531 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab52059a-a8b5-42fd-8c73-c93c29438a9f-kube-api-access-x5lvb" (OuterVolumeSpecName: "kube-api-access-x5lvb") pod "ab52059a-a8b5-42fd-8c73-c93c29438a9f" (UID: "ab52059a-a8b5-42fd-8c73-c93c29438a9f"). InnerVolumeSpecName "kube-api-access-x5lvb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:29:35.900947 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.900907 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-util" (OuterVolumeSpecName: "util") pod "ab52059a-a8b5-42fd-8c73-c93c29438a9f" (UID: "ab52059a-a8b5-42fd-8c73-c93c29438a9f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:29:35.996362 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.996270 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:29:35.996362 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.996300 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ab52059a-a8b5-42fd-8c73-c93c29438a9f-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:29:35.996362 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:35.996312 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5lvb\" (UniqueName: \"kubernetes.io/projected/ab52059a-a8b5-42fd-8c73-c93c29438a9f-kube-api-access-x5lvb\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:29:36.663120 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:36.663089 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" Jul 14 20:29:36.663298 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:36.663086 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ks78q" event={"ID":"ab52059a-a8b5-42fd-8c73-c93c29438a9f","Type":"ContainerDied","Data":"6a14315ebefda533c762c1ca6254c8139c653cc2af4aa45ac31a6948bdc9bbc2"} Jul 14 20:29:36.663298 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:36.663210 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a14315ebefda533c762c1ca6254c8139c653cc2af4aa45ac31a6948bdc9bbc2" Jul 14 20:29:48.464100 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464065 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts"] Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464398 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="pull" Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464410 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="pull" Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464428 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="extract" Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464433 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="extract" Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464441 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="util" Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464446 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="util" Jul 14 20:29:48.464541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.464507 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab52059a-a8b5-42fd-8c73-c93c29438a9f" containerName="extract" Jul 14 20:29:48.469122 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.469101 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.477363 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.477342 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 20:29:48.477510 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.477487 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfr7t\"" Jul 14 20:29:48.477766 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.477753 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 20:29:48.504574 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.504546 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts"] Jul 14 20:29:48.510323 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.510293 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.510468 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.510422 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.510534 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.510481 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdtzk\" (UniqueName: \"kubernetes.io/projected/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-kube-api-access-mdtzk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.611283 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.611245 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.611493 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.611308 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.611493 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.611341 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdtzk\" (UniqueName: \"kubernetes.io/projected/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-kube-api-access-mdtzk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.611709 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.611688 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.611781 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.611760 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.648884 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.648850 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdtzk\" (UniqueName: \"kubernetes.io/projected/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-kube-api-access-mdtzk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.777822 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.777731 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:48.951602 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:48.951560 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts"] Jul 14 20:29:48.954476 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:29:48.954444 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37c9236a_b3d0_4285_8ae1_aaefe2faa44b.slice/crio-cca6c7fa7418264073c6026f3c17be7930adcc078ce15d7d621a1232d0e28469 WatchSource:0}: Error finding container cca6c7fa7418264073c6026f3c17be7930adcc078ce15d7d621a1232d0e28469: Status 404 returned error can't find the container with id cca6c7fa7418264073c6026f3c17be7930adcc078ce15d7d621a1232d0e28469 Jul 14 20:29:49.715953 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:49.715921 2566 generic.go:356] "Generic (PLEG): container finished" podID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerID="afc89cdf12428adf8a17cbbbaa6c18c58a8460fa1aa4e7c58c8f36f2ea1f582a" exitCode=0 Jul 14 20:29:49.716367 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:49.716010 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" event={"ID":"37c9236a-b3d0-4285-8ae1-aaefe2faa44b","Type":"ContainerDied","Data":"afc89cdf12428adf8a17cbbbaa6c18c58a8460fa1aa4e7c58c8f36f2ea1f582a"} Jul 14 20:29:49.716367 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:49.716066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" event={"ID":"37c9236a-b3d0-4285-8ae1-aaefe2faa44b","Type":"ContainerStarted","Data":"cca6c7fa7418264073c6026f3c17be7930adcc078ce15d7d621a1232d0e28469"} Jul 14 20:29:51.728908 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:51.728865 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" event={"ID":"37c9236a-b3d0-4285-8ae1-aaefe2faa44b","Type":"ContainerStarted","Data":"7c34d1ed23556011ebeccbd3dcb9bcbfd03197cf963ed16a91a13e2eb1d9d591"} Jul 14 20:29:52.734540 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:52.734491 2566 generic.go:356] "Generic (PLEG): container finished" podID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerID="7c34d1ed23556011ebeccbd3dcb9bcbfd03197cf963ed16a91a13e2eb1d9d591" exitCode=0 Jul 14 20:29:52.734924 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:52.734558 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" event={"ID":"37c9236a-b3d0-4285-8ae1-aaefe2faa44b","Type":"ContainerDied","Data":"7c34d1ed23556011ebeccbd3dcb9bcbfd03197cf963ed16a91a13e2eb1d9d591"} Jul 14 20:29:53.741217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:53.741176 2566 generic.go:356] "Generic (PLEG): container finished" podID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerID="9a8385277cd2fb970f0c1de11f2535b347ad2418acd72ef8ab2ff3491aa1f441" exitCode=0 Jul 14 20:29:53.741659 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:53.741264 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" event={"ID":"37c9236a-b3d0-4285-8ae1-aaefe2faa44b","Type":"ContainerDied","Data":"9a8385277cd2fb970f0c1de11f2535b347ad2418acd72ef8ab2ff3491aa1f441"} Jul 14 20:29:54.871818 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.871792 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:54.964483 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.964451 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mdtzk\" (UniqueName: \"kubernetes.io/projected/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-kube-api-access-mdtzk\") pod \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " Jul 14 20:29:54.964698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.964516 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-util\") pod \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " Jul 14 20:29:54.964698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.964563 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-bundle\") pod \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\" (UID: \"37c9236a-b3d0-4285-8ae1-aaefe2faa44b\") " Jul 14 20:29:54.965011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.964983 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-bundle" (OuterVolumeSpecName: "bundle") pod "37c9236a-b3d0-4285-8ae1-aaefe2faa44b" (UID: "37c9236a-b3d0-4285-8ae1-aaefe2faa44b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:29:54.966775 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.966746 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-kube-api-access-mdtzk" (OuterVolumeSpecName: "kube-api-access-mdtzk") pod "37c9236a-b3d0-4285-8ae1-aaefe2faa44b" (UID: "37c9236a-b3d0-4285-8ae1-aaefe2faa44b"). InnerVolumeSpecName "kube-api-access-mdtzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:29:54.969859 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:54.969831 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-util" (OuterVolumeSpecName: "util") pod "37c9236a-b3d0-4285-8ae1-aaefe2faa44b" (UID: "37c9236a-b3d0-4285-8ae1-aaefe2faa44b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:29:55.065902 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.065862 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:29:55.065902 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.065908 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:29:55.066195 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.065924 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mdtzk\" (UniqueName: \"kubernetes.io/projected/37c9236a-b3d0-4285-8ae1-aaefe2faa44b-kube-api-access-mdtzk\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:29:55.383269 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383185 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jbz69"] Jul 14 20:29:55.383542 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383530 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="pull" Jul 14 20:29:55.383585 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383544 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="pull" Jul 14 20:29:55.383585 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383553 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="extract" Jul 14 20:29:55.383585 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383558 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="extract" Jul 14 20:29:55.383585 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383576 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="util" Jul 14 20:29:55.383585 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383581 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="util" Jul 14 20:29:55.383729 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.383648 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="37c9236a-b3d0-4285-8ae1-aaefe2faa44b" containerName="extract" Jul 14 20:29:55.385851 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.385829 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.389309 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.389287 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 14 20:29:55.389812 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.389796 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 14 20:29:55.389907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.389798 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-wttg5\"" Jul 14 20:29:55.401984 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.401947 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jbz69"] Jul 14 20:29:55.469422 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.469388 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f028b900-d21f-47f0-ad81-bf28fdf62826-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jbz69\" (UID: \"f028b900-d21f-47f0-ad81-bf28fdf62826\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.469611 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.469473 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6w82j\" (UniqueName: \"kubernetes.io/projected/f028b900-d21f-47f0-ad81-bf28fdf62826-kube-api-access-6w82j\") pod \"cert-manager-cainjector-559cdd8c87-jbz69\" (UID: \"f028b900-d21f-47f0-ad81-bf28fdf62826\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.570865 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.570828 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6w82j\" (UniqueName: \"kubernetes.io/projected/f028b900-d21f-47f0-ad81-bf28fdf62826-kube-api-access-6w82j\") pod \"cert-manager-cainjector-559cdd8c87-jbz69\" (UID: \"f028b900-d21f-47f0-ad81-bf28fdf62826\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.571082 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.570891 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f028b900-d21f-47f0-ad81-bf28fdf62826-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jbz69\" (UID: \"f028b900-d21f-47f0-ad81-bf28fdf62826\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.586300 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.586274 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f028b900-d21f-47f0-ad81-bf28fdf62826-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-jbz69\" (UID: \"f028b900-d21f-47f0-ad81-bf28fdf62826\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.587705 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.587677 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6w82j\" (UniqueName: \"kubernetes.io/projected/f028b900-d21f-47f0-ad81-bf28fdf62826-kube-api-access-6w82j\") pod \"cert-manager-cainjector-559cdd8c87-jbz69\" (UID: \"f028b900-d21f-47f0-ad81-bf28fdf62826\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.708949 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.708855 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" Jul 14 20:29:55.753040 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.753015 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" Jul 14 20:29:55.753206 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.753003 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fp2rts" event={"ID":"37c9236a-b3d0-4285-8ae1-aaefe2faa44b","Type":"ContainerDied","Data":"cca6c7fa7418264073c6026f3c17be7930adcc078ce15d7d621a1232d0e28469"} Jul 14 20:29:55.753206 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.753136 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cca6c7fa7418264073c6026f3c17be7930adcc078ce15d7d621a1232d0e28469" Jul 14 20:29:55.859268 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:55.859238 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-jbz69"] Jul 14 20:29:55.863311 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:29:55.863279 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf028b900_d21f_47f0_ad81_bf28fdf62826.slice/crio-67904fe9d1629797c460fe3e82a15711d63fb07891ef4ca2f530b283fab2f788 WatchSource:0}: Error finding container 67904fe9d1629797c460fe3e82a15711d63fb07891ef4ca2f530b283fab2f788: Status 404 returned error can't find the container with id 67904fe9d1629797c460fe3e82a15711d63fb07891ef4ca2f530b283fab2f788 Jul 14 20:29:56.758082 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:29:56.758047 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" event={"ID":"f028b900-d21f-47f0-ad81-bf28fdf62826","Type":"ContainerStarted","Data":"67904fe9d1629797c460fe3e82a15711d63fb07891ef4ca2f530b283fab2f788"} Jul 14 20:30:01.785350 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:01.785255 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" event={"ID":"f028b900-d21f-47f0-ad81-bf28fdf62826","Type":"ContainerStarted","Data":"f01dc820aa87c6411993ba60499981b23c432ec721a32f6e3bd3a74106cc87d4"} Jul 14 20:30:01.816606 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:01.816552 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-jbz69" podStartSLOduration=1.38466375 podStartE2EDuration="6.816535807s" totalImagesPullingTime="5.431872057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:01.815556449 +0000 UTC m=+468.383672426" watchObservedRunningTime="2026-07-14 20:30:01.816535807 +0000 UTC m=+468.384651784" Jul 14 20:30:08.474622 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.474585 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq"] Jul 14 20:30:08.477208 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.477191 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.479846 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.479821 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-hfr7t\"" Jul 14 20:30:08.480030 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.480012 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 14 20:30:08.480318 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.480304 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 14 20:30:08.489047 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.489012 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq"] Jul 14 20:30:08.592260 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.592217 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttgrm\" (UniqueName: \"kubernetes.io/projected/c4751d79-7d84-450e-b269-e9140e1c9ced-kube-api-access-ttgrm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.592260 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.592261 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.592442 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.592372 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.693145 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.693101 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttgrm\" (UniqueName: \"kubernetes.io/projected/c4751d79-7d84-450e-b269-e9140e1c9ced-kube-api-access-ttgrm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.693336 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.693152 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.693336 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.693222 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.693609 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.693586 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.693674 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.693618 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.701749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.701716 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttgrm\" (UniqueName: \"kubernetes.io/projected/c4751d79-7d84-450e-b269-e9140e1c9ced-kube-api-access-ttgrm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.787223 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.787123 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:08.923476 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:08.923450 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq"] Jul 14 20:30:08.925936 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:30:08.925913 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4751d79_7d84_450e_b269_e9140e1c9ced.slice/crio-3d90430ffc641f95b69e24f8e597986d071816a8a3e8ce0508b08b0a631fb278 WatchSource:0}: Error finding container 3d90430ffc641f95b69e24f8e597986d071816a8a3e8ce0508b08b0a631fb278: Status 404 returned error can't find the container with id 3d90430ffc641f95b69e24f8e597986d071816a8a3e8ce0508b08b0a631fb278 Jul 14 20:30:09.827622 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:09.827586 2566 generic.go:356] "Generic (PLEG): container finished" podID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerID="dde78310ef14d953df692ad2c1d76cbe4c7b46d5797d18d81da0d3b7ad807a64" exitCode=0 Jul 14 20:30:09.828011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:09.827673 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" event={"ID":"c4751d79-7d84-450e-b269-e9140e1c9ced","Type":"ContainerDied","Data":"dde78310ef14d953df692ad2c1d76cbe4c7b46d5797d18d81da0d3b7ad807a64"} Jul 14 20:30:09.828011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:09.827723 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" event={"ID":"c4751d79-7d84-450e-b269-e9140e1c9ced","Type":"ContainerStarted","Data":"3d90430ffc641f95b69e24f8e597986d071816a8a3e8ce0508b08b0a631fb278"} Jul 14 20:30:10.839501 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:10.839462 2566 generic.go:356] "Generic (PLEG): container finished" podID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerID="b7add4220dc089faa266c5f7ae5710d019f238a2ed53302eda84df2b5a1f6644" exitCode=0 Jul 14 20:30:10.839907 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:10.839549 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" event={"ID":"c4751d79-7d84-450e-b269-e9140e1c9ced","Type":"ContainerDied","Data":"b7add4220dc089faa266c5f7ae5710d019f238a2ed53302eda84df2b5a1f6644"} Jul 14 20:30:11.846527 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:11.846490 2566 generic.go:356] "Generic (PLEG): container finished" podID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerID="bd398826c14a4e88aaaef47c6ac8734f5cb520c82b1b6ed5105b00b3b539d251" exitCode=0 Jul 14 20:30:11.846910 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:11.846572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" event={"ID":"c4751d79-7d84-450e-b269-e9140e1c9ced","Type":"ContainerDied","Data":"bd398826c14a4e88aaaef47c6ac8734f5cb520c82b1b6ed5105b00b3b539d251"} Jul 14 20:30:12.977048 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:12.977025 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:13.132599 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.132495 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttgrm\" (UniqueName: \"kubernetes.io/projected/c4751d79-7d84-450e-b269-e9140e1c9ced-kube-api-access-ttgrm\") pod \"c4751d79-7d84-450e-b269-e9140e1c9ced\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " Jul 14 20:30:13.132777 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.132609 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-bundle\") pod \"c4751d79-7d84-450e-b269-e9140e1c9ced\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " Jul 14 20:30:13.132777 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.132634 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-util\") pod \"c4751d79-7d84-450e-b269-e9140e1c9ced\" (UID: \"c4751d79-7d84-450e-b269-e9140e1c9ced\") " Jul 14 20:30:13.133349 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.133323 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-bundle" (OuterVolumeSpecName: "bundle") pod "c4751d79-7d84-450e-b269-e9140e1c9ced" (UID: "c4751d79-7d84-450e-b269-e9140e1c9ced"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:30:13.134665 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.134643 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4751d79-7d84-450e-b269-e9140e1c9ced-kube-api-access-ttgrm" (OuterVolumeSpecName: "kube-api-access-ttgrm") pod "c4751d79-7d84-450e-b269-e9140e1c9ced" (UID: "c4751d79-7d84-450e-b269-e9140e1c9ced"). InnerVolumeSpecName "kube-api-access-ttgrm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:30:13.138323 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.138294 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-util" (OuterVolumeSpecName: "util") pod "c4751d79-7d84-450e-b269-e9140e1c9ced" (UID: "c4751d79-7d84-450e-b269-e9140e1c9ced"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:30:13.233734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.233694 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:30:13.233734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.233728 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c4751d79-7d84-450e-b269-e9140e1c9ced-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:30:13.233734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.233738 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttgrm\" (UniqueName: \"kubernetes.io/projected/c4751d79-7d84-450e-b269-e9140e1c9ced-kube-api-access-ttgrm\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:30:13.857198 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.857170 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" Jul 14 20:30:13.857396 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.857196 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afn9vqq" event={"ID":"c4751d79-7d84-450e-b269-e9140e1c9ced","Type":"ContainerDied","Data":"3d90430ffc641f95b69e24f8e597986d071816a8a3e8ce0508b08b0a631fb278"} Jul 14 20:30:13.857396 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:13.857245 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d90430ffc641f95b69e24f8e597986d071816a8a3e8ce0508b08b0a631fb278" Jul 14 20:30:16.705786 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.705739 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck"] Jul 14 20:30:16.706279 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706227 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="pull" Jul 14 20:30:16.706279 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706245 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="pull" Jul 14 20:30:16.706279 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706265 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="util" Jul 14 20:30:16.706279 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706275 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="util" Jul 14 20:30:16.706496 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706286 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="extract" Jul 14 20:30:16.706496 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706294 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="extract" Jul 14 20:30:16.706496 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.706407 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4751d79-7d84-450e-b269-e9140e1c9ced" containerName="extract" Jul 14 20:30:16.708913 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.708893 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.711397 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.711374 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 14 20:30:16.711891 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.711868 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 14 20:30:16.712032 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.711868 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 14 20:30:16.712204 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.712187 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 14 20:30:16.712258 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.712239 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-2cfhw\"" Jul 14 20:30:16.712326 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.712312 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 14 20:30:16.728181 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.728148 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck"] Jul 14 20:30:16.864613 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.864579 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83f74421-eda2-4cfe-b358-9a5c63cb16d2-cert\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.864799 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.864636 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr2fj\" (UniqueName: \"kubernetes.io/projected/83f74421-eda2-4cfe-b358-9a5c63cb16d2-kube-api-access-xr2fj\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.864799 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.864714 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83f74421-eda2-4cfe-b358-9a5c63cb16d2-metrics-cert\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.864799 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.864780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83f74421-eda2-4cfe-b358-9a5c63cb16d2-manager-config\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.965860 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.965758 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83f74421-eda2-4cfe-b358-9a5c63cb16d2-manager-config\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.965860 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.965805 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83f74421-eda2-4cfe-b358-9a5c63cb16d2-cert\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.965860 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.965840 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr2fj\" (UniqueName: \"kubernetes.io/projected/83f74421-eda2-4cfe-b358-9a5c63cb16d2-kube-api-access-xr2fj\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.966194 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.965873 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83f74421-eda2-4cfe-b358-9a5c63cb16d2-metrics-cert\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.966529 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.966502 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/83f74421-eda2-4cfe-b358-9a5c63cb16d2-manager-config\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.968509 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.968486 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/83f74421-eda2-4cfe-b358-9a5c63cb16d2-metrics-cert\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.968509 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.968503 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/83f74421-eda2-4cfe-b358-9a5c63cb16d2-cert\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:16.982025 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:16.981992 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr2fj\" (UniqueName: \"kubernetes.io/projected/83f74421-eda2-4cfe-b358-9a5c63cb16d2-kube-api-access-xr2fj\") pod \"lws-controller-manager-78b47f4478-8bxck\" (UID: \"83f74421-eda2-4cfe-b358-9a5c63cb16d2\") " pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:17.018041 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:17.017992 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:17.177163 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:17.177136 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck"] Jul 14 20:30:17.179574 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:30:17.179549 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83f74421_eda2_4cfe_b358_9a5c63cb16d2.slice/crio-c3260b0a9aecdfc168c1dc95f65a890785b99b5093b29fbfd795d2b38c46cfee WatchSource:0}: Error finding container c3260b0a9aecdfc168c1dc95f65a890785b99b5093b29fbfd795d2b38c46cfee: Status 404 returned error can't find the container with id c3260b0a9aecdfc168c1dc95f65a890785b99b5093b29fbfd795d2b38c46cfee Jul 14 20:30:17.877737 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:17.877703 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" event={"ID":"83f74421-eda2-4cfe-b358-9a5c63cb16d2","Type":"ContainerStarted","Data":"c3260b0a9aecdfc168c1dc95f65a890785b99b5093b29fbfd795d2b38c46cfee"} Jul 14 20:30:19.889037 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:19.888999 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" event={"ID":"83f74421-eda2-4cfe-b358-9a5c63cb16d2","Type":"ContainerStarted","Data":"a6b934b97849b9b9667857c2590c1e2e1dd21fcb3aa5c17dc24b28b648832bb5"} Jul 14 20:30:19.889635 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:19.889103 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:19.919878 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:19.916007 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" podStartSLOduration=2.19882145 podStartE2EDuration="3.915985456s" totalImagesPullingTime="1.717164006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:19.914551293 +0000 UTC m=+486.482667271" watchObservedRunningTime="2026-07-14 20:30:19.915985456 +0000 UTC m=+486.484101435" Jul 14 20:30:21.701496 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.701464 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb"] Jul 14 20:30:21.703843 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.703827 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.707380 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.707347 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 14 20:30:21.707380 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.707370 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 14 20:30:21.707698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.707681 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ptlqj\"" Jul 14 20:30:21.707967 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.707935 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 14 20:30:21.708047 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.707938 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 14 20:30:21.731781 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.731758 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb"] Jul 14 20:30:21.815148 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.815111 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6acbac2-ea70-4bf3-92a1-221de360431f-manifests\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.815337 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.815168 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6acbac2-ea70-4bf3-92a1-221de360431f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.815337 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.815190 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6acbac2-ea70-4bf3-92a1-221de360431f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.815337 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.815282 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6acbac2-ea70-4bf3-92a1-221de360431f-tmp\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.815337 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.815318 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pg5j\" (UniqueName: \"kubernetes.io/projected/f6acbac2-ea70-4bf3-92a1-221de360431f-kube-api-access-6pg5j\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.916297 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.916265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6acbac2-ea70-4bf3-92a1-221de360431f-tmp\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.916486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.916303 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pg5j\" (UniqueName: \"kubernetes.io/projected/f6acbac2-ea70-4bf3-92a1-221de360431f-kube-api-access-6pg5j\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.916486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.916351 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6acbac2-ea70-4bf3-92a1-221de360431f-manifests\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.916486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.916388 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6acbac2-ea70-4bf3-92a1-221de360431f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.916486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.916414 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6acbac2-ea70-4bf3-92a1-221de360431f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.916782 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.916756 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f6acbac2-ea70-4bf3-92a1-221de360431f-manifests\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.918594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.918509 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6acbac2-ea70-4bf3-92a1-221de360431f-tmp\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.918915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.918887 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f6acbac2-ea70-4bf3-92a1-221de360431f-apiservice-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.919036 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.918887 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f6acbac2-ea70-4bf3-92a1-221de360431f-webhook-cert\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:21.929039 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:21.929013 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pg5j\" (UniqueName: \"kubernetes.io/projected/f6acbac2-ea70-4bf3-92a1-221de360431f-kube-api-access-6pg5j\") pod \"opendatahub-operator-controller-manager-79d49c7b87-fh7sb\" (UID: \"f6acbac2-ea70-4bf3-92a1-221de360431f\") " pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:22.014365 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:22.014280 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:22.157106 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:22.157083 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb"] Jul 14 20:30:22.159528 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:30:22.159504 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6acbac2_ea70_4bf3_92a1_221de360431f.slice/crio-248305c55a9312c0cca6eabe22f03251f41ffe7b9313a3cc776d55c3c4962aa9 WatchSource:0}: Error finding container 248305c55a9312c0cca6eabe22f03251f41ffe7b9313a3cc776d55c3c4962aa9: Status 404 returned error can't find the container with id 248305c55a9312c0cca6eabe22f03251f41ffe7b9313a3cc776d55c3c4962aa9 Jul 14 20:30:22.904015 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:22.903981 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" event={"ID":"f6acbac2-ea70-4bf3-92a1-221de360431f","Type":"ContainerStarted","Data":"248305c55a9312c0cca6eabe22f03251f41ffe7b9313a3cc776d55c3c4962aa9"} Jul 14 20:30:26.928296 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:26.928261 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" event={"ID":"f6acbac2-ea70-4bf3-92a1-221de360431f","Type":"ContainerStarted","Data":"13252b41640bc626cdc38b15b25e552b11cb88172e57498605be017a4ebda81c"} Jul 14 20:30:27.934774 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:27.934740 2566 generic.go:356] "Generic (PLEG): container finished" podID="f6acbac2-ea70-4bf3-92a1-221de360431f" containerID="13252b41640bc626cdc38b15b25e552b11cb88172e57498605be017a4ebda81c" exitCode=0 Jul 14 20:30:27.935161 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:27.934799 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" event={"ID":"f6acbac2-ea70-4bf3-92a1-221de360431f","Type":"ContainerDied","Data":"13252b41640bc626cdc38b15b25e552b11cb88172e57498605be017a4ebda81c"} Jul 14 20:30:28.941440 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:28.941406 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" event={"ID":"f6acbac2-ea70-4bf3-92a1-221de360431f","Type":"ContainerStarted","Data":"42a5cf288cf22b933a167f1487f7635f2e9dd81b276b3208fe412a58724c817f"} Jul 14 20:30:28.941817 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:28.941524 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:28.969124 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:28.969063 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" podStartSLOduration=2.645650811 podStartE2EDuration="7.969040189s" totalImagesPullingTime="4.299583568s" totalInitContainerRuntime="1.02380581s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:28.967889126 +0000 UTC m=+495.536005100" watchObservedRunningTime="2026-07-14 20:30:28.969040189 +0000 UTC m=+495.537156167" Jul 14 20:30:30.895578 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:30.895550 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-78b47f4478-8bxck" Jul 14 20:30:39.949335 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:39.949303 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-79d49c7b87-fh7sb" Jul 14 20:30:45.196631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.196593 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl"] Jul 14 20:30:45.200383 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.200364 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.203536 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.203514 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 14 20:30:45.204054 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.204034 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-nc9tl\"" Jul 14 20:30:45.204719 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.204698 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 14 20:30:45.216344 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.216320 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl"] Jul 14 20:30:45.317079 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.317041 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wztfx\" (UniqueName: \"kubernetes.io/projected/9fa7bf6c-8213-43f1-91af-d737a332890d-kube-api-access-wztfx\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.317257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.317092 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fa7bf6c-8213-43f1-91af-d737a332890d-tmp\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.317257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.317154 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa7bf6c-8213-43f1-91af-d737a332890d-tls-certs\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.418362 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.418329 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wztfx\" (UniqueName: \"kubernetes.io/projected/9fa7bf6c-8213-43f1-91af-d737a332890d-kube-api-access-wztfx\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.418525 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.418383 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fa7bf6c-8213-43f1-91af-d737a332890d-tmp\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.418525 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.418410 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa7bf6c-8213-43f1-91af-d737a332890d-tls-certs\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.420776 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.420739 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fa7bf6c-8213-43f1-91af-d737a332890d-tmp\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.421562 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.421541 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9fa7bf6c-8213-43f1-91af-d737a332890d-tls-certs\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.435680 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.435652 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wztfx\" (UniqueName: \"kubernetes.io/projected/9fa7bf6c-8213-43f1-91af-d737a332890d-kube-api-access-wztfx\") pod \"kube-auth-proxy-75fb49cfc4-zd5zl\" (UID: \"9fa7bf6c-8213-43f1-91af-d737a332890d\") " pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.510388 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.510307 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" Jul 14 20:30:45.663065 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:45.663034 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl"] Jul 14 20:30:45.665527 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:30:45.665500 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa7bf6c_8213_43f1_91af_d737a332890d.slice/crio-d3a9b497def838a7aa6c0e58bc8e7e15230e472d257a156921b5120add9e0e9d WatchSource:0}: Error finding container d3a9b497def838a7aa6c0e58bc8e7e15230e472d257a156921b5120add9e0e9d: Status 404 returned error can't find the container with id d3a9b497def838a7aa6c0e58bc8e7e15230e472d257a156921b5120add9e0e9d Jul 14 20:30:46.024598 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:46.024556 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" event={"ID":"9fa7bf6c-8213-43f1-91af-d737a332890d","Type":"ContainerStarted","Data":"d3a9b497def838a7aa6c0e58bc8e7e15230e472d257a156921b5120add9e0e9d"} Jul 14 20:30:50.046551 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:50.046506 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" event={"ID":"9fa7bf6c-8213-43f1-91af-d737a332890d","Type":"ContainerStarted","Data":"a5477e40285b75cb85b475fc9f30035f12e681f1678ccec1190565ba05fbd8aa"} Jul 14 20:30:50.065855 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:30:50.065778 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75fb49cfc4-zd5zl" podStartSLOduration=1.556508294 podStartE2EDuration="5.065760651s" totalImagesPullingTime="3.509252357s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:30:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:30:50.062753407 +0000 UTC m=+516.630869396" watchObservedRunningTime="2026-07-14 20:30:50.065760651 +0000 UTC m=+516.633876627" Jul 14 20:31:58.908229 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.908193 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2"] Jul 14 20:31:58.911651 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.911634 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:58.913643 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.913612 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 20:31:58.913766 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.913702 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 20:31:58.914125 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.914110 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n7vmj\"" Jul 14 20:31:58.918982 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.918784 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2"] Jul 14 20:31:58.999694 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.999662 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:58.999873 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.999713 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:58.999873 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:58.999749 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7gv6\" (UniqueName: \"kubernetes.io/projected/d9f2b153-0254-4f21-a99a-e563669025cc-kube-api-access-c7gv6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.100829 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.100794 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.101061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.100857 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.101061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.100890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7gv6\" (UniqueName: \"kubernetes.io/projected/d9f2b153-0254-4f21-a99a-e563669025cc-kube-api-access-c7gv6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.101285 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.101263 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.101348 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.101291 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.108586 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.108554 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7gv6\" (UniqueName: \"kubernetes.io/projected/d9f2b153-0254-4f21-a99a-e563669025cc-kube-api-access-c7gv6\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.222149 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.222062 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:31:59.357609 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.357582 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2"] Jul 14 20:31:59.360279 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:31:59.360253 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9f2b153_0254_4f21_a99a_e563669025cc.slice/crio-f6baef39549918ffdc354cb6a7084fc7ca3eedaa48981ce433e6714087cc4b02 WatchSource:0}: Error finding container f6baef39549918ffdc354cb6a7084fc7ca3eedaa48981ce433e6714087cc4b02: Status 404 returned error can't find the container with id f6baef39549918ffdc354cb6a7084fc7ca3eedaa48981ce433e6714087cc4b02 Jul 14 20:31:59.388662 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.388633 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" event={"ID":"d9f2b153-0254-4f21-a99a-e563669025cc","Type":"ContainerStarted","Data":"f6baef39549918ffdc354cb6a7084fc7ca3eedaa48981ce433e6714087cc4b02"} Jul 14 20:31:59.522253 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.522163 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd"] Jul 14 20:31:59.525911 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.525892 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.534301 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.534269 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd"] Jul 14 20:31:59.604381 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.604343 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.604547 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.604465 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.604547 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.604518 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6qd6\" (UniqueName: \"kubernetes.io/projected/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-kube-api-access-j6qd6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.705335 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.705290 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.705529 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.705346 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6qd6\" (UniqueName: \"kubernetes.io/projected/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-kube-api-access-j6qd6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.705529 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.705392 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.705757 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.705734 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.705793 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.705747 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.713924 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.713895 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6qd6\" (UniqueName: \"kubernetes.io/projected/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-kube-api-access-j6qd6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.842696 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.842658 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:31:59.914303 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.914270 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf"] Jul 14 20:31:59.917927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.917903 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:31:59.925094 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.925065 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf"] Jul 14 20:31:59.979625 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:31:59.979595 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd"] Jul 14 20:31:59.982873 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:31:59.982849 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09adec61_4e76_4ac2_a6d6_fcf5230d8e51.slice/crio-7b1dc64c01116021e2c08cb0b76765351f3d6e588169b84c56a7cf90b71f7866 WatchSource:0}: Error finding container 7b1dc64c01116021e2c08cb0b76765351f3d6e588169b84c56a7cf90b71f7866: Status 404 returned error can't find the container with id 7b1dc64c01116021e2c08cb0b76765351f3d6e588169b84c56a7cf90b71f7866 Jul 14 20:32:00.008591 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.008565 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.008723 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.008700 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.008797 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.008779 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcckm\" (UniqueName: \"kubernetes.io/projected/82ea08c8-3452-4afa-9d81-686f7a9916f9-kube-api-access-jcckm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.109655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.109561 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.109655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.109624 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcckm\" (UniqueName: \"kubernetes.io/projected/82ea08c8-3452-4afa-9d81-686f7a9916f9-kube-api-access-jcckm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.109864 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.109665 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.109974 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.109937 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.110062 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.110044 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.117653 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.117625 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcckm\" (UniqueName: \"kubernetes.io/projected/82ea08c8-3452-4afa-9d81-686f7a9916f9-kube-api-access-jcckm\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.228910 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.228865 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:00.313479 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.313448 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw"] Jul 14 20:32:00.318213 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.318189 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.324854 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.324823 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw"] Jul 14 20:32:00.369410 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.369370 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf"] Jul 14 20:32:00.372028 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:32:00.371998 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ea08c8_3452_4afa_9d81_686f7a9916f9.slice/crio-3e1617143bd44f6fb22003276c2c7b0a00590ffe44d23eaff257fb9815e93c89 WatchSource:0}: Error finding container 3e1617143bd44f6fb22003276c2c7b0a00590ffe44d23eaff257fb9815e93c89: Status 404 returned error can't find the container with id 3e1617143bd44f6fb22003276c2c7b0a00590ffe44d23eaff257fb9815e93c89 Jul 14 20:32:00.396052 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.396021 2566 generic.go:356] "Generic (PLEG): container finished" podID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerID="9e2a73ebaf8b87183b0a9198bd60828a9f3bdb4726681ef0791d980c88551d5f" exitCode=0 Jul 14 20:32:00.396178 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.396105 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" event={"ID":"09adec61-4e76-4ac2-a6d6-fcf5230d8e51","Type":"ContainerDied","Data":"9e2a73ebaf8b87183b0a9198bd60828a9f3bdb4726681ef0791d980c88551d5f"} Jul 14 20:32:00.396238 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.396173 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" event={"ID":"09adec61-4e76-4ac2-a6d6-fcf5230d8e51","Type":"ContainerStarted","Data":"7b1dc64c01116021e2c08cb0b76765351f3d6e588169b84c56a7cf90b71f7866"} Jul 14 20:32:00.397560 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.397536 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" event={"ID":"82ea08c8-3452-4afa-9d81-686f7a9916f9","Type":"ContainerStarted","Data":"3e1617143bd44f6fb22003276c2c7b0a00590ffe44d23eaff257fb9815e93c89"} Jul 14 20:32:00.399074 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.399050 2566 generic.go:356] "Generic (PLEG): container finished" podID="d9f2b153-0254-4f21-a99a-e563669025cc" containerID="87e82e49879bfe4ff8649405cd834bd003cd1361f84a7391426e398750992964" exitCode=0 Jul 14 20:32:00.399177 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.399108 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" event={"ID":"d9f2b153-0254-4f21-a99a-e563669025cc","Type":"ContainerDied","Data":"87e82e49879bfe4ff8649405cd834bd003cd1361f84a7391426e398750992964"} Jul 14 20:32:00.412506 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.412482 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.412777 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.412755 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nwrb\" (UniqueName: \"kubernetes.io/projected/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-kube-api-access-6nwrb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.412987 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.412945 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.513822 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.513785 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nwrb\" (UniqueName: \"kubernetes.io/projected/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-kube-api-access-6nwrb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.513983 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.513859 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.513983 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.513890 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.514319 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.514302 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.514360 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.514338 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.522408 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.522380 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nwrb\" (UniqueName: \"kubernetes.io/projected/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-kube-api-access-6nwrb\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.630302 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.630214 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:00.764579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:00.764553 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw"] Jul 14 20:32:00.766989 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:32:00.766937 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8de3fc9_d2f4_4fb6_93ae_eb028d90666e.slice/crio-a2c2eb60de996f20394065eed897dc4d79ade8fed8fc11ae148260dd31807af6 WatchSource:0}: Error finding container a2c2eb60de996f20394065eed897dc4d79ade8fed8fc11ae148260dd31807af6: Status 404 returned error can't find the container with id a2c2eb60de996f20394065eed897dc4d79ade8fed8fc11ae148260dd31807af6 Jul 14 20:32:01.406606 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.406579 2566 generic.go:356] "Generic (PLEG): container finished" podID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerID="b4c1cc0f2976ab9d3781d8f8d0dea1892c58dec507bad080e54ea7207d3a482e" exitCode=0 Jul 14 20:32:01.407075 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.406657 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" event={"ID":"09adec61-4e76-4ac2-a6d6-fcf5230d8e51","Type":"ContainerDied","Data":"b4c1cc0f2976ab9d3781d8f8d0dea1892c58dec507bad080e54ea7207d3a482e"} Jul 14 20:32:01.408366 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.408343 2566 generic.go:356] "Generic (PLEG): container finished" podID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerID="cd5a9deeeca56251a93fe46fefb7fb4290aa7c066f8fc0a6bf83b2e24307a584" exitCode=0 Jul 14 20:32:01.408434 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.408416 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" event={"ID":"82ea08c8-3452-4afa-9d81-686f7a9916f9","Type":"ContainerDied","Data":"cd5a9deeeca56251a93fe46fefb7fb4290aa7c066f8fc0a6bf83b2e24307a584"} Jul 14 20:32:01.409877 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.409855 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerID="0fac5c9619b36d06ba78df712c933f6c70c854a4e70afd72c79de48a41e9a8b0" exitCode=0 Jul 14 20:32:01.409996 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.409882 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" event={"ID":"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e","Type":"ContainerDied","Data":"0fac5c9619b36d06ba78df712c933f6c70c854a4e70afd72c79de48a41e9a8b0"} Jul 14 20:32:01.409996 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:01.409946 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" event={"ID":"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e","Type":"ContainerStarted","Data":"a2c2eb60de996f20394065eed897dc4d79ade8fed8fc11ae148260dd31807af6"} Jul 14 20:32:02.421217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:02.421136 2566 generic.go:356] "Generic (PLEG): container finished" podID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerID="2d9c85c66ca7c99aa9a69b1bc4afc29040da6dadc612f1875599b27b7ec62343" exitCode=0 Jul 14 20:32:02.421217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:02.421174 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" event={"ID":"09adec61-4e76-4ac2-a6d6-fcf5230d8e51","Type":"ContainerDied","Data":"2d9c85c66ca7c99aa9a69b1bc4afc29040da6dadc612f1875599b27b7ec62343"} Jul 14 20:32:02.422852 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:02.422827 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerID="e85e35a70a106a604fc0de0b22d0a9ab59a3ceef2b9c125b3cb0d36ebfc72f83" exitCode=0 Jul 14 20:32:02.423009 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:02.422910 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" event={"ID":"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e","Type":"ContainerDied","Data":"e85e35a70a106a604fc0de0b22d0a9ab59a3ceef2b9c125b3cb0d36ebfc72f83"} Jul 14 20:32:02.424734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:02.424708 2566 generic.go:356] "Generic (PLEG): container finished" podID="d9f2b153-0254-4f21-a99a-e563669025cc" containerID="72d64ae11c8b6ce966f236c46d3062b042ad26d596e94154ce9e6ee30c63e6cf" exitCode=0 Jul 14 20:32:02.424858 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:02.424735 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" event={"ID":"d9f2b153-0254-4f21-a99a-e563669025cc","Type":"ContainerDied","Data":"72d64ae11c8b6ce966f236c46d3062b042ad26d596e94154ce9e6ee30c63e6cf"} Jul 14 20:32:03.431659 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.431553 2566 generic.go:356] "Generic (PLEG): container finished" podID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerID="e4c1d3f964740d05baf0efd5d79b7fb5b56e797a1d84699462a5f664c290663c" exitCode=0 Jul 14 20:32:03.432109 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.431647 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" event={"ID":"82ea08c8-3452-4afa-9d81-686f7a9916f9","Type":"ContainerDied","Data":"e4c1d3f964740d05baf0efd5d79b7fb5b56e797a1d84699462a5f664c290663c"} Jul 14 20:32:03.433774 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.433752 2566 generic.go:356] "Generic (PLEG): container finished" podID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerID="08200e443d68b1225fbf85e974707a55fff80d0110d2fe4c50de95af48720a69" exitCode=0 Jul 14 20:32:03.433871 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.433801 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" event={"ID":"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e","Type":"ContainerDied","Data":"08200e443d68b1225fbf85e974707a55fff80d0110d2fe4c50de95af48720a69"} Jul 14 20:32:03.436040 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.436019 2566 generic.go:356] "Generic (PLEG): container finished" podID="d9f2b153-0254-4f21-a99a-e563669025cc" containerID="b2b99db86ca7e163eb78620b42d7bee265fa8f95c5994f0221bc5112a5fb2495" exitCode=0 Jul 14 20:32:03.436117 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.436066 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" event={"ID":"d9f2b153-0254-4f21-a99a-e563669025cc","Type":"ContainerDied","Data":"b2b99db86ca7e163eb78620b42d7bee265fa8f95c5994f0221bc5112a5fb2495"} Jul 14 20:32:03.585590 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.585567 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:32:03.645852 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.645816 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-util\") pod \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " Jul 14 20:32:03.646061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.645881 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j6qd6\" (UniqueName: \"kubernetes.io/projected/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-kube-api-access-j6qd6\") pod \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " Jul 14 20:32:03.646061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.645905 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-bundle\") pod \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\" (UID: \"09adec61-4e76-4ac2-a6d6-fcf5230d8e51\") " Jul 14 20:32:03.646506 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.646470 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-bundle" (OuterVolumeSpecName: "bundle") pod "09adec61-4e76-4ac2-a6d6-fcf5230d8e51" (UID: "09adec61-4e76-4ac2-a6d6-fcf5230d8e51"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:03.648054 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.648034 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-kube-api-access-j6qd6" (OuterVolumeSpecName: "kube-api-access-j6qd6") pod "09adec61-4e76-4ac2-a6d6-fcf5230d8e51" (UID: "09adec61-4e76-4ac2-a6d6-fcf5230d8e51"). InnerVolumeSpecName "kube-api-access-j6qd6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:03.651288 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.651255 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-util" (OuterVolumeSpecName: "util") pod "09adec61-4e76-4ac2-a6d6-fcf5230d8e51" (UID: "09adec61-4e76-4ac2-a6d6-fcf5230d8e51"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:03.746929 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.746836 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6qd6\" (UniqueName: \"kubernetes.io/projected/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-kube-api-access-j6qd6\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:03.746929 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.746877 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:03.746929 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:03.746888 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/09adec61-4e76-4ac2-a6d6-fcf5230d8e51-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:04.443171 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.443137 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" Jul 14 20:32:04.443171 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.443154 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd" event={"ID":"09adec61-4e76-4ac2-a6d6-fcf5230d8e51","Type":"ContainerDied","Data":"7b1dc64c01116021e2c08cb0b76765351f3d6e588169b84c56a7cf90b71f7866"} Jul 14 20:32:04.443635 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.443210 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7b1dc64c01116021e2c08cb0b76765351f3d6e588169b84c56a7cf90b71f7866" Jul 14 20:32:04.445586 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.445556 2566 generic.go:356] "Generic (PLEG): container finished" podID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerID="4e789dee00f4cdcfafd824ec862022a615d6d7d85c5051b7072f6af07eff797e" exitCode=0 Jul 14 20:32:04.445721 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.445655 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" event={"ID":"82ea08c8-3452-4afa-9d81-686f7a9916f9","Type":"ContainerDied","Data":"4e789dee00f4cdcfafd824ec862022a615d6d7d85c5051b7072f6af07eff797e"} Jul 14 20:32:04.580169 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.580133 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:32:04.617310 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.617284 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:04.654484 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.654459 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-bundle\") pod \"d9f2b153-0254-4f21-a99a-e563669025cc\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " Jul 14 20:32:04.654484 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.654488 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7gv6\" (UniqueName: \"kubernetes.io/projected/d9f2b153-0254-4f21-a99a-e563669025cc-kube-api-access-c7gv6\") pod \"d9f2b153-0254-4f21-a99a-e563669025cc\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " Jul 14 20:32:04.654718 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.654510 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-util\") pod \"d9f2b153-0254-4f21-a99a-e563669025cc\" (UID: \"d9f2b153-0254-4f21-a99a-e563669025cc\") " Jul 14 20:32:04.654718 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.654534 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-util\") pod \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " Jul 14 20:32:04.654718 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.654555 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6nwrb\" (UniqueName: \"kubernetes.io/projected/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-kube-api-access-6nwrb\") pod \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " Jul 14 20:32:04.654718 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.654579 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-bundle\") pod \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\" (UID: \"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e\") " Jul 14 20:32:04.655328 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.655249 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-bundle" (OuterVolumeSpecName: "bundle") pod "c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" (UID: "c8de3fc9-d2f4-4fb6-93ae-eb028d90666e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:04.655328 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.655279 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-bundle" (OuterVolumeSpecName: "bundle") pod "d9f2b153-0254-4f21-a99a-e563669025cc" (UID: "d9f2b153-0254-4f21-a99a-e563669025cc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:04.656773 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.656742 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f2b153-0254-4f21-a99a-e563669025cc-kube-api-access-c7gv6" (OuterVolumeSpecName: "kube-api-access-c7gv6") pod "d9f2b153-0254-4f21-a99a-e563669025cc" (UID: "d9f2b153-0254-4f21-a99a-e563669025cc"). InnerVolumeSpecName "kube-api-access-c7gv6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:04.657441 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.657415 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-kube-api-access-6nwrb" (OuterVolumeSpecName: "kube-api-access-6nwrb") pod "c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" (UID: "c8de3fc9-d2f4-4fb6-93ae-eb028d90666e"). InnerVolumeSpecName "kube-api-access-6nwrb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:04.660713 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.660689 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-util" (OuterVolumeSpecName: "util") pod "d9f2b153-0254-4f21-a99a-e563669025cc" (UID: "d9f2b153-0254-4f21-a99a-e563669025cc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:04.661011 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.660991 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-util" (OuterVolumeSpecName: "util") pod "c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" (UID: "c8de3fc9-d2f4-4fb6-93ae-eb028d90666e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:04.755579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.755493 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:04.755579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.755524 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7gv6\" (UniqueName: \"kubernetes.io/projected/d9f2b153-0254-4f21-a99a-e563669025cc-kube-api-access-c7gv6\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:04.755579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.755537 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9f2b153-0254-4f21-a99a-e563669025cc-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:04.755579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.755546 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:04.755579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.755556 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6nwrb\" (UniqueName: \"kubernetes.io/projected/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-kube-api-access-6nwrb\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:04.755579 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:04.755565 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c8de3fc9-d2f4-4fb6-93ae-eb028d90666e-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:05.452617 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.452536 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" Jul 14 20:32:05.452617 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.452570 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2" event={"ID":"d9f2b153-0254-4f21-a99a-e563669025cc","Type":"ContainerDied","Data":"f6baef39549918ffdc354cb6a7084fc7ca3eedaa48981ce433e6714087cc4b02"} Jul 14 20:32:05.452617 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.452615 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6baef39549918ffdc354cb6a7084fc7ca3eedaa48981ce433e6714087cc4b02" Jul 14 20:32:05.454477 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.454453 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" event={"ID":"c8de3fc9-d2f4-4fb6-93ae-eb028d90666e","Type":"ContainerDied","Data":"a2c2eb60de996f20394065eed897dc4d79ade8fed8fc11ae148260dd31807af6"} Jul 14 20:32:05.454591 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.454503 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2c2eb60de996f20394065eed897dc4d79ade8fed8fc11ae148260dd31807af6" Jul 14 20:32:05.454591 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.454467 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw" Jul 14 20:32:05.586782 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.586757 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:05.664893 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.664857 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcckm\" (UniqueName: \"kubernetes.io/projected/82ea08c8-3452-4afa-9d81-686f7a9916f9-kube-api-access-jcckm\") pod \"82ea08c8-3452-4afa-9d81-686f7a9916f9\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " Jul 14 20:32:05.665066 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.664921 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-bundle\") pod \"82ea08c8-3452-4afa-9d81-686f7a9916f9\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " Jul 14 20:32:05.665066 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.664979 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-util\") pod \"82ea08c8-3452-4afa-9d81-686f7a9916f9\" (UID: \"82ea08c8-3452-4afa-9d81-686f7a9916f9\") " Jul 14 20:32:05.665506 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.665472 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-bundle" (OuterVolumeSpecName: "bundle") pod "82ea08c8-3452-4afa-9d81-686f7a9916f9" (UID: "82ea08c8-3452-4afa-9d81-686f7a9916f9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:05.667077 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.667050 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ea08c8-3452-4afa-9d81-686f7a9916f9-kube-api-access-jcckm" (OuterVolumeSpecName: "kube-api-access-jcckm") pod "82ea08c8-3452-4afa-9d81-686f7a9916f9" (UID: "82ea08c8-3452-4afa-9d81-686f7a9916f9"). InnerVolumeSpecName "kube-api-access-jcckm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:05.670206 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.670181 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-util" (OuterVolumeSpecName: "util") pod "82ea08c8-3452-4afa-9d81-686f7a9916f9" (UID: "82ea08c8-3452-4afa-9d81-686f7a9916f9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 14 20:32:05.766098 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.766005 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcckm\" (UniqueName: \"kubernetes.io/projected/82ea08c8-3452-4afa-9d81-686f7a9916f9-kube-api-access-jcckm\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:05.766098 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.766041 2566 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:05.766098 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:05.766050 2566 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/82ea08c8-3452-4afa-9d81-686f7a9916f9-util\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:06.460926 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:06.460898 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" Jul 14 20:32:06.460926 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:06.460907 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf" event={"ID":"82ea08c8-3452-4afa-9d81-686f7a9916f9","Type":"ContainerDied","Data":"3e1617143bd44f6fb22003276c2c7b0a00590ffe44d23eaff257fb9815e93c89"} Jul 14 20:32:06.461360 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:06.460981 2566 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3e1617143bd44f6fb22003276c2c7b0a00590ffe44d23eaff257fb9815e93c89" Jul 14 20:32:11.487439 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.487398 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c56bb569c-bvsl4"] Jul 14 20:32:11.488381 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488356 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="util" Jul 14 20:32:11.488381 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488382 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488401 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488410 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488419 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488427 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488437 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="extract" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488445 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="extract" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488456 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488463 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488473 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488482 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="util" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488490 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="extract" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488497 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="extract" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488513 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488521 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488533 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488540 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488555 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488563 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="pull" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488572 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="extract" Jul 14 20:32:11.488575 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488580 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="extract" Jul 14 20:32:11.489432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488603 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="extract" Jul 14 20:32:11.489432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488611 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="extract" Jul 14 20:32:11.489432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488709 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="09adec61-4e76-4ac2-a6d6-fcf5230d8e51" containerName="extract" Jul 14 20:32:11.489432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488722 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8de3fc9-d2f4-4fb6-93ae-eb028d90666e" containerName="extract" Jul 14 20:32:11.489432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488731 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ea08c8-3452-4afa-9d81-686f7a9916f9" containerName="extract" Jul 14 20:32:11.489432 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.488753 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9f2b153-0254-4f21-a99a-e563669025cc" containerName="extract" Jul 14 20:32:11.492057 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.492021 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.505617 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.505588 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c56bb569c-bvsl4"] Jul 14 20:32:11.618893 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.618856 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-config\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.619054 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.618911 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-oauth-config\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.619054 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.619025 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-serving-cert\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.619182 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.619056 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-oauth-serving-cert\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.619182 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.619091 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlck4\" (UniqueName: \"kubernetes.io/projected/31dd8beb-61a0-4887-9f83-cc716e0c322e-kube-api-access-dlck4\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.619182 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.619167 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-service-ca\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.619311 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.619220 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-trusted-ca-bundle\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720673 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720634 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-service-ca\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720673 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720680 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-trusted-ca-bundle\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720886 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720703 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-config\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720886 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720749 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-oauth-config\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720886 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720783 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-serving-cert\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720886 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720809 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-oauth-serving-cert\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.720886 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.720832 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlck4\" (UniqueName: \"kubernetes.io/projected/31dd8beb-61a0-4887-9f83-cc716e0c322e-kube-api-access-dlck4\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.721515 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.721486 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-service-ca\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.721645 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.721571 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-config\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.721645 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.721588 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-oauth-serving-cert\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.721645 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.721617 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd8beb-61a0-4887-9f83-cc716e0c322e-trusted-ca-bundle\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.723349 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.723325 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-oauth-config\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.723436 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.723418 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/31dd8beb-61a0-4887-9f83-cc716e0c322e-console-serving-cert\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.731592 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.731571 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlck4\" (UniqueName: \"kubernetes.io/projected/31dd8beb-61a0-4887-9f83-cc716e0c322e-kube-api-access-dlck4\") pod \"console-c56bb569c-bvsl4\" (UID: \"31dd8beb-61a0-4887-9f83-cc716e0c322e\") " pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.801543 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.801509 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:11.951257 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:11.945892 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c56bb569c-bvsl4"] Jul 14 20:32:12.497503 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:12.497454 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c56bb569c-bvsl4" event={"ID":"31dd8beb-61a0-4887-9f83-cc716e0c322e","Type":"ContainerStarted","Data":"cf8d4f34a6397416daa375c25849496273cb8dbfdcdbedac8a60060bbdb3448c"} Jul 14 20:32:12.497945 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:12.497523 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c56bb569c-bvsl4" event={"ID":"31dd8beb-61a0-4887-9f83-cc716e0c322e","Type":"ContainerStarted","Data":"ae574eb5e393606543d2ceb68a7dd4d4f1e0b1ce2e1b560d902cadd677d1b29e"} Jul 14 20:32:12.519631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:12.519541 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c56bb569c-bvsl4" podStartSLOduration=1.519524773 podStartE2EDuration="1.519524773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:12.516460744 +0000 UTC m=+599.084576746" watchObservedRunningTime="2026-07-14 20:32:12.519524773 +0000 UTC m=+599.087640750" Jul 14 20:32:13.888330 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:13.888306 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:32:13.888749 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:13.888365 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:32:13.895245 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:13.895225 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:32:13.895376 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:13.895312 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:32:21.802430 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:21.802391 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:21.806046 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:21.802458 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:21.807050 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:21.807028 2566 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:22.555621 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:22.555593 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c56bb569c-bvsl4" Jul 14 20:32:22.619129 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:22.619093 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4c8c9c88-2ddnk"] Jul 14 20:32:28.557618 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.557580 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl"] Jul 14 20:32:28.561202 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.561178 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.563489 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.563464 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 14 20:32:28.563621 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.563510 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 14 20:32:28.563685 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.563665 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 14 20:32:28.563741 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.563727 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-n7vmj\"" Jul 14 20:32:28.564013 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.563998 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 14 20:32:28.569196 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.569175 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl"] Jul 14 20:32:28.676430 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.676379 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77hmx\" (UniqueName: \"kubernetes.io/projected/444bddfa-b3b7-4df8-bb6e-103ab866406e-kube-api-access-77hmx\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.676631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.676514 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/444bddfa-b3b7-4df8-bb6e-103ab866406e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.676631 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.676590 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/444bddfa-b3b7-4df8-bb6e-103ab866406e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.778039 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.777997 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/444bddfa-b3b7-4df8-bb6e-103ab866406e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.778241 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.778081 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-77hmx\" (UniqueName: \"kubernetes.io/projected/444bddfa-b3b7-4df8-bb6e-103ab866406e-kube-api-access-77hmx\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.778241 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.778135 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/444bddfa-b3b7-4df8-bb6e-103ab866406e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.778241 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:32:28.778222 2566 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 14 20:32:28.778421 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:32:28.778278 2566 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/444bddfa-b3b7-4df8-bb6e-103ab866406e-plugin-serving-cert podName:444bddfa-b3b7-4df8-bb6e-103ab866406e nodeName:}" failed. No retries permitted until 2026-07-14 20:32:29.278261814 +0000 UTC m=+615.846377769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/444bddfa-b3b7-4df8-bb6e-103ab866406e-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-72pvl" (UID: "444bddfa-b3b7-4df8-bb6e-103ab866406e") : secret "plugin-serving-cert" not found Jul 14 20:32:28.778785 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.778758 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/444bddfa-b3b7-4df8-bb6e-103ab866406e-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:28.788983 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:28.787255 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-77hmx\" (UniqueName: \"kubernetes.io/projected/444bddfa-b3b7-4df8-bb6e-103ab866406e-kube-api-access-77hmx\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:29.283318 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:29.283277 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/444bddfa-b3b7-4df8-bb6e-103ab866406e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:29.285732 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:29.285704 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/444bddfa-b3b7-4df8-bb6e-103ab866406e-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-72pvl\" (UID: \"444bddfa-b3b7-4df8-bb6e-103ab866406e\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:29.472306 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:29.472266 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" Jul 14 20:32:29.634495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:29.634388 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl"] Jul 14 20:32:29.636716 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:32:29.636676 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod444bddfa_b3b7_4df8_bb6e_103ab866406e.slice/crio-64eada3f203ef7b4edb410183ce8cb25bba8f47dc6d76faa7fe0f2b76951ced5 WatchSource:0}: Error finding container 64eada3f203ef7b4edb410183ce8cb25bba8f47dc6d76faa7fe0f2b76951ced5: Status 404 returned error can't find the container with id 64eada3f203ef7b4edb410183ce8cb25bba8f47dc6d76faa7fe0f2b76951ced5 Jul 14 20:32:30.599051 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:30.599003 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" event={"ID":"444bddfa-b3b7-4df8-bb6e-103ab866406e","Type":"ContainerStarted","Data":"64eada3f203ef7b4edb410183ce8cb25bba8f47dc6d76faa7fe0f2b76951ced5"} Jul 14 20:32:47.643503 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:47.643152 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b4c8c9c88-2ddnk" podUID="1742db5c-321a-4cbf-a07b-332e298f2da7" containerName="console" containerID="cri-o://9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06" gracePeriod=15 Jul 14 20:32:52.380351 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:52.380312 2566 patch_prober.go:28] interesting pod/console-b4c8c9c88-2ddnk container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.132.0.26:8443/health\": dial tcp 10.132.0.26:8443: connect: connection refused" start-of-body= Jul 14 20:32:52.380822 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:52.380376 2566 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-b4c8c9c88-2ddnk" podUID="1742db5c-321a-4cbf-a07b-332e298f2da7" containerName="console" probeResult="failure" output="Get \"https://10.132.0.26:8443/health\": dial tcp 10.132.0.26:8443: connect: connection refused" Jul 14 20:32:54.031789 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.031758 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:32:54.128317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128239 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-service-ca\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128285 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-console-config\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128313 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5hjw\" (UniqueName: \"kubernetes.io/projected/1742db5c-321a-4cbf-a07b-332e298f2da7-kube-api-access-j5hjw\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128596 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128353 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-oauth-serving-cert\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128596 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128391 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-serving-cert\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128696 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128622 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-oauth-config\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128696 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128668 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-trusted-ca-bundle\") pod \"1742db5c-321a-4cbf-a07b-332e298f2da7\" (UID: \"1742db5c-321a-4cbf-a07b-332e298f2da7\") " Jul 14 20:32:54.128801 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128705 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-service-ca" (OuterVolumeSpecName: "service-ca") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:32:54.128801 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128765 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-console-config" (OuterVolumeSpecName: "console-config") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:32:54.128908 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.128811 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:32:54.129119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.129093 2566 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-console-config\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.129119 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.129118 2566 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-oauth-serving-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.129314 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.129133 2566 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-service-ca\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.129314 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.129184 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 14 20:32:54.130657 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.130629 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1742db5c-321a-4cbf-a07b-332e298f2da7-kube-api-access-j5hjw" (OuterVolumeSpecName: "kube-api-access-j5hjw") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "kube-api-access-j5hjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:32:54.130755 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.130735 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:32:54.130797 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.130757 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1742db5c-321a-4cbf-a07b-332e298f2da7" (UID: "1742db5c-321a-4cbf-a07b-332e298f2da7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:32:54.230390 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.230349 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5hjw\" (UniqueName: \"kubernetes.io/projected/1742db5c-321a-4cbf-a07b-332e298f2da7-kube-api-access-j5hjw\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.230390 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.230382 2566 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-serving-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.230390 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.230391 2566 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1742db5c-321a-4cbf-a07b-332e298f2da7-console-oauth-config\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.230390 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.230400 2566 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1742db5c-321a-4cbf-a07b-332e298f2da7-trusted-ca-bundle\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:32:54.745118 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.745030 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" event={"ID":"444bddfa-b3b7-4df8-bb6e-103ab866406e","Type":"ContainerStarted","Data":"282d39b2aa11e682ade8a7c097f576dddf247e55a27dbc88e50ad840bf546665"} Jul 14 20:32:54.746341 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.746310 2566 generic.go:356] "Generic (PLEG): container finished" podID="1742db5c-321a-4cbf-a07b-332e298f2da7" containerID="9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06" exitCode=0 Jul 14 20:32:54.746479 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.746375 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b4c8c9c88-2ddnk" Jul 14 20:32:54.746479 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.746398 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4c8c9c88-2ddnk" event={"ID":"1742db5c-321a-4cbf-a07b-332e298f2da7","Type":"ContainerDied","Data":"9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06"} Jul 14 20:32:54.746594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.746491 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b4c8c9c88-2ddnk" event={"ID":"1742db5c-321a-4cbf-a07b-332e298f2da7","Type":"ContainerDied","Data":"8d333940e8abc76bd446ff97db9afea66725db88362b788eeb2e70e69dbd50be"} Jul 14 20:32:54.746594 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.746522 2566 scope.go:117] "RemoveContainer" containerID="9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06" Jul 14 20:32:54.755529 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.755508 2566 scope.go:117] "RemoveContainer" containerID="9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06" Jul 14 20:32:54.755819 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:32:54.755798 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06\": container with ID starting with 9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06 not found: ID does not exist" containerID="9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06" Jul 14 20:32:54.755861 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.755827 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06"} err="failed to get container status \"9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06\": rpc error: code = NotFound desc = could not find container \"9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06\": container with ID starting with 9ed814d99612ad8345ed31e86ca8c80b1b660aa25ffab064214e967b00a52c06 not found: ID does not exist" Jul 14 20:32:54.761264 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.761221 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-72pvl" podStartSLOduration=2.114848117 podStartE2EDuration="26.761206314s" totalImagesPullingTime="24.646358197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:32:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:32:54.758945638 +0000 UTC m=+641.327061611" watchObservedRunningTime="2026-07-14 20:32:54.761206314 +0000 UTC m=+641.329322372" Jul 14 20:32:54.775829 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.775794 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b4c8c9c88-2ddnk"] Jul 14 20:32:54.779714 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:54.779685 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b4c8c9c88-2ddnk"] Jul 14 20:32:56.004248 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:32:56.004216 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1742db5c-321a-4cbf-a07b-332e298f2da7" path="/var/lib/kubelet/pods/1742db5c-321a-4cbf-a07b-332e298f2da7/volumes" Jul 14 20:33:10.663829 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.663791 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:33:10.664317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.664183 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1742db5c-321a-4cbf-a07b-332e298f2da7" containerName="console" Jul 14 20:33:10.664317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.664196 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="1742db5c-321a-4cbf-a07b-332e298f2da7" containerName="console" Jul 14 20:33:10.664317 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.664248 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="1742db5c-321a-4cbf-a07b-332e298f2da7" containerName="console" Jul 14 20:33:10.666227 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.666211 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.669415 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.669390 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 14 20:33:10.676283 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.676256 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:33:10.704685 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.704661 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:33:10.781340 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.781306 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b6ae161-187b-4acc-abc4-1bb84b3df6ed-config-file\") pod \"limitador-limitador-54d6d988d5-f97w2\" (UID: \"6b6ae161-187b-4acc-abc4-1bb84b3df6ed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.781495 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.781346 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cdjd\" (UniqueName: \"kubernetes.io/projected/6b6ae161-187b-4acc-abc4-1bb84b3df6ed-kube-api-access-6cdjd\") pod \"limitador-limitador-54d6d988d5-f97w2\" (UID: \"6b6ae161-187b-4acc-abc4-1bb84b3df6ed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.882752 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.882704 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b6ae161-187b-4acc-abc4-1bb84b3df6ed-config-file\") pod \"limitador-limitador-54d6d988d5-f97w2\" (UID: \"6b6ae161-187b-4acc-abc4-1bb84b3df6ed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.882752 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.882753 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cdjd\" (UniqueName: \"kubernetes.io/projected/6b6ae161-187b-4acc-abc4-1bb84b3df6ed-kube-api-access-6cdjd\") pod \"limitador-limitador-54d6d988d5-f97w2\" (UID: \"6b6ae161-187b-4acc-abc4-1bb84b3df6ed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.883390 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.883369 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6b6ae161-187b-4acc-abc4-1bb84b3df6ed-config-file\") pod \"limitador-limitador-54d6d988d5-f97w2\" (UID: \"6b6ae161-187b-4acc-abc4-1bb84b3df6ed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.890647 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.890617 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cdjd\" (UniqueName: \"kubernetes.io/projected/6b6ae161-187b-4acc-abc4-1bb84b3df6ed-kube-api-access-6cdjd\") pod \"limitador-limitador-54d6d988d5-f97w2\" (UID: \"6b6ae161-187b-4acc-abc4-1bb84b3df6ed\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:10.983500 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:10.983406 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:11.100479 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.100436 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-s7qjz"] Jul 14 20:33:11.103987 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.103945 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:11.106256 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.106234 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5w2cd\"" Jul 14 20:33:11.110462 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.110436 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7qjz"] Jul 14 20:33:11.123613 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.123584 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:33:11.127368 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:33:11.127339 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b6ae161_187b_4acc_abc4_1bb84b3df6ed.slice/crio-0926774fc4f0b5109918b257453ef5927a81e9de55aa05b4fa52f1b721b026b8 WatchSource:0}: Error finding container 0926774fc4f0b5109918b257453ef5927a81e9de55aa05b4fa52f1b721b026b8: Status 404 returned error can't find the container with id 0926774fc4f0b5109918b257453ef5927a81e9de55aa05b4fa52f1b721b026b8 Jul 14 20:33:11.286573 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.286467 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncrlz\" (UniqueName: \"kubernetes.io/projected/013ab2c1-b1da-40f3-8d51-df437e61b9d1-kube-api-access-ncrlz\") pod \"authorino-58cd955675-s7qjz\" (UID: \"013ab2c1-b1da-40f3-8d51-df437e61b9d1\") " pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:11.387541 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.387500 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncrlz\" (UniqueName: \"kubernetes.io/projected/013ab2c1-b1da-40f3-8d51-df437e61b9d1-kube-api-access-ncrlz\") pod \"authorino-58cd955675-s7qjz\" (UID: \"013ab2c1-b1da-40f3-8d51-df437e61b9d1\") " pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:11.396881 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.396847 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncrlz\" (UniqueName: \"kubernetes.io/projected/013ab2c1-b1da-40f3-8d51-df437e61b9d1-kube-api-access-ncrlz\") pod \"authorino-58cd955675-s7qjz\" (UID: \"013ab2c1-b1da-40f3-8d51-df437e61b9d1\") " pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:11.415788 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.415757 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:11.544255 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.544231 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7qjz"] Jul 14 20:33:11.546141 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:33:11.546112 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod013ab2c1_b1da_40f3_8d51_df437e61b9d1.slice/crio-c0430cf0001b2c5ab2656bbbeac90d57206be906a65ce0da7e8090e0e66702d3 WatchSource:0}: Error finding container c0430cf0001b2c5ab2656bbbeac90d57206be906a65ce0da7e8090e0e66702d3: Status 404 returned error can't find the container with id c0430cf0001b2c5ab2656bbbeac90d57206be906a65ce0da7e8090e0e66702d3 Jul 14 20:33:11.846168 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.846129 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" event={"ID":"6b6ae161-187b-4acc-abc4-1bb84b3df6ed","Type":"ContainerStarted","Data":"0926774fc4f0b5109918b257453ef5927a81e9de55aa05b4fa52f1b721b026b8"} Jul 14 20:33:11.847396 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:11.847370 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7qjz" event={"ID":"013ab2c1-b1da-40f3-8d51-df437e61b9d1","Type":"ContainerStarted","Data":"c0430cf0001b2c5ab2656bbbeac90d57206be906a65ce0da7e8090e0e66702d3"} Jul 14 20:33:16.439070 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:16.439037 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7qjz"] Jul 14 20:33:16.881825 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:16.881786 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" event={"ID":"6b6ae161-187b-4acc-abc4-1bb84b3df6ed","Type":"ContainerStarted","Data":"1f75ab484f527489299d16e1e438f28a48ae5e9a9e5cb9cdc6494794bec02370"} Jul 14 20:33:16.882057 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:16.881892 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:16.883293 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:16.883272 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7qjz" event={"ID":"013ab2c1-b1da-40f3-8d51-df437e61b9d1","Type":"ContainerStarted","Data":"b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83"} Jul 14 20:33:16.900724 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:16.900679 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" podStartSLOduration=1.736562836 podStartE2EDuration="6.900664676s" totalImagesPullingTime="5.16410184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:16.897830805 +0000 UTC m=+663.465946784" watchObservedRunningTime="2026-07-14 20:33:16.900664676 +0000 UTC m=+663.468780653" Jul 14 20:33:16.911027 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:16.910940 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-s7qjz" podStartSLOduration=1.1636299270000001 podStartE2EDuration="5.910922422s" totalImagesPullingTime="4.747292495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:16.910669616 +0000 UTC m=+663.478785580" watchObservedRunningTime="2026-07-14 20:33:16.910922422 +0000 UTC m=+663.479038401" Jul 14 20:33:17.888311 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:17.888268 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-s7qjz" podUID="013ab2c1-b1da-40f3-8d51-df437e61b9d1" containerName="authorino" containerID="cri-o://b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83" gracePeriod=30 Jul 14 20:33:18.141574 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.141510 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:18.250864 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.250833 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncrlz\" (UniqueName: \"kubernetes.io/projected/013ab2c1-b1da-40f3-8d51-df437e61b9d1-kube-api-access-ncrlz\") pod \"013ab2c1-b1da-40f3-8d51-df437e61b9d1\" (UID: \"013ab2c1-b1da-40f3-8d51-df437e61b9d1\") " Jul 14 20:33:18.253061 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.253029 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/013ab2c1-b1da-40f3-8d51-df437e61b9d1-kube-api-access-ncrlz" (OuterVolumeSpecName: "kube-api-access-ncrlz") pod "013ab2c1-b1da-40f3-8d51-df437e61b9d1" (UID: "013ab2c1-b1da-40f3-8d51-df437e61b9d1"). InnerVolumeSpecName "kube-api-access-ncrlz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:33:18.352036 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.352002 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncrlz\" (UniqueName: \"kubernetes.io/projected/013ab2c1-b1da-40f3-8d51-df437e61b9d1-kube-api-access-ncrlz\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:33:18.895298 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.895260 2566 generic.go:356] "Generic (PLEG): container finished" podID="013ab2c1-b1da-40f3-8d51-df437e61b9d1" containerID="b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83" exitCode=0 Jul 14 20:33:18.895298 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.895297 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-s7qjz" Jul 14 20:33:18.895784 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.895340 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7qjz" event={"ID":"013ab2c1-b1da-40f3-8d51-df437e61b9d1","Type":"ContainerDied","Data":"b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83"} Jul 14 20:33:18.895784 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.895382 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-s7qjz" event={"ID":"013ab2c1-b1da-40f3-8d51-df437e61b9d1","Type":"ContainerDied","Data":"c0430cf0001b2c5ab2656bbbeac90d57206be906a65ce0da7e8090e0e66702d3"} Jul 14 20:33:18.895784 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.895399 2566 scope.go:117] "RemoveContainer" containerID="b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83" Jul 14 20:33:18.905877 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.905862 2566 scope.go:117] "RemoveContainer" containerID="b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83" Jul 14 20:33:18.906166 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:33:18.906147 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83\": container with ID starting with b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83 not found: ID does not exist" containerID="b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83" Jul 14 20:33:18.906246 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.906177 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83"} err="failed to get container status \"b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83\": rpc error: code = NotFound desc = could not find container \"b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83\": container with ID starting with b24068b2907ec9fb0b9ffc16bcc63cc964cb928a29254dc9694087c1512abd83 not found: ID does not exist" Jul 14 20:33:18.916081 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.916058 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7qjz"] Jul 14 20:33:18.919596 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:18.919563 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-s7qjz"] Jul 14 20:33:20.003423 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:20.003381 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="013ab2c1-b1da-40f3-8d51-df437e61b9d1" path="/var/lib/kubelet/pods/013ab2c1-b1da-40f3-8d51-df437e61b9d1/volumes" Jul 14 20:33:27.890482 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:27.890444 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-f97w2" Jul 14 20:33:44.107124 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.107086 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hj45v"] Jul 14 20:33:44.107511 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.107446 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="013ab2c1-b1da-40f3-8d51-df437e61b9d1" containerName="authorino" Jul 14 20:33:44.107511 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.107456 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="013ab2c1-b1da-40f3-8d51-df437e61b9d1" containerName="authorino" Jul 14 20:33:44.107584 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.107554 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="013ab2c1-b1da-40f3-8d51-df437e61b9d1" containerName="authorino" Jul 14 20:33:44.109689 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.109672 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:44.111674 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.111649 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5w2cd\"" Jul 14 20:33:44.115709 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.115683 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hj45v"] Jul 14 20:33:44.189444 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.189406 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb4hs\" (UniqueName: \"kubernetes.io/projected/b76165cf-05d2-4857-ada9-5050ddceaf0f-kube-api-access-cb4hs\") pod \"authorino-5d4b67c446-hj45v\" (UID: \"b76165cf-05d2-4857-ada9-5050ddceaf0f\") " pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:44.290661 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.290612 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb4hs\" (UniqueName: \"kubernetes.io/projected/b76165cf-05d2-4857-ada9-5050ddceaf0f-kube-api-access-cb4hs\") pod \"authorino-5d4b67c446-hj45v\" (UID: \"b76165cf-05d2-4857-ada9-5050ddceaf0f\") " pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:44.299364 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.299330 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb4hs\" (UniqueName: \"kubernetes.io/projected/b76165cf-05d2-4857-ada9-5050ddceaf0f-kube-api-access-cb4hs\") pod \"authorino-5d4b67c446-hj45v\" (UID: \"b76165cf-05d2-4857-ada9-5050ddceaf0f\") " pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:44.333574 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.333538 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hj45v"] Jul 14 20:33:44.333820 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.333809 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:44.359942 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.359874 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-n52nw"] Jul 14 20:33:44.362732 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.362712 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:44.364755 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.364733 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 20:33:44.372182 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.372150 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-n52nw"] Jul 14 20:33:44.398178 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.398145 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-n52nw"] Jul 14 20:33:44.398506 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:33:44.398472 2566 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-c8kh4 tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-c8kh4 tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-n52nw" podUID="9fa80d85-f100-438f-9186-fd070471083f" Jul 14 20:33:44.470146 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.470117 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hj45v"] Jul 14 20:33:44.472749 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:33:44.472721 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb76165cf_05d2_4857_ada9_5050ddceaf0f.slice/crio-b189a40fc272df5b44755277575cdb18ee60059092908ac7c4fa8fcaf99b8a2e WatchSource:0}: Error finding container b189a40fc272df5b44755277575cdb18ee60059092908ac7c4fa8fcaf99b8a2e: Status 404 returned error can't find the container with id b189a40fc272df5b44755277575cdb18ee60059092908ac7c4fa8fcaf99b8a2e Jul 14 20:33:44.474228 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.474192 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:33:44.492973 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.492929 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8kh4\" (UniqueName: \"kubernetes.io/projected/9fa80d85-f100-438f-9186-fd070471083f-kube-api-access-c8kh4\") pod \"authorino-76877994-n52nw\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:44.493098 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.492995 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fa80d85-f100-438f-9186-fd070471083f-tls-cert\") pod \"authorino-76877994-n52nw\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:44.593926 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.593888 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8kh4\" (UniqueName: \"kubernetes.io/projected/9fa80d85-f100-438f-9186-fd070471083f-kube-api-access-c8kh4\") pod \"authorino-76877994-n52nw\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:44.594127 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.593939 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fa80d85-f100-438f-9186-fd070471083f-tls-cert\") pod \"authorino-76877994-n52nw\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:44.596381 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.596352 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fa80d85-f100-438f-9186-fd070471083f-tls-cert\") pod \"authorino-76877994-n52nw\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:44.601147 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:44.601121 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8kh4\" (UniqueName: \"kubernetes.io/projected/9fa80d85-f100-438f-9186-fd070471083f-kube-api-access-c8kh4\") pod \"authorino-76877994-n52nw\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:45.033581 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.033554 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:45.033581 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.033572 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hj45v" event={"ID":"b76165cf-05d2-4857-ada9-5050ddceaf0f","Type":"ContainerStarted","Data":"5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656"} Jul 14 20:33:45.033829 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.033619 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hj45v" event={"ID":"b76165cf-05d2-4857-ada9-5050ddceaf0f","Type":"ContainerStarted","Data":"b189a40fc272df5b44755277575cdb18ee60059092908ac7c4fa8fcaf99b8a2e"} Jul 14 20:33:45.033829 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.033632 2566 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-hj45v" podUID="b76165cf-05d2-4857-ada9-5050ddceaf0f" containerName="authorino" containerID="cri-o://5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656" gracePeriod=30 Jul 14 20:33:45.039921 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.039899 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:45.063539 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.063491 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-hj45v" podStartSLOduration=0.606222183 podStartE2EDuration="1.063476085s" totalImagesPullingTime="457.253902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:33:45.047096832 +0000 UTC m=+691.615212809" watchObservedRunningTime="2026-07-14 20:33:45.063476085 +0000 UTC m=+691.631592062" Jul 14 20:33:45.097702 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.097670 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c8kh4\" (UniqueName: \"kubernetes.io/projected/9fa80d85-f100-438f-9186-fd070471083f-kube-api-access-c8kh4\") pod \"9fa80d85-f100-438f-9186-fd070471083f\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " Jul 14 20:33:45.097864 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.097788 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fa80d85-f100-438f-9186-fd070471083f-tls-cert\") pod \"9fa80d85-f100-438f-9186-fd070471083f\" (UID: \"9fa80d85-f100-438f-9186-fd070471083f\") " Jul 14 20:33:45.099884 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.099855 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9fa80d85-f100-438f-9186-fd070471083f-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9fa80d85-f100-438f-9186-fd070471083f" (UID: "9fa80d85-f100-438f-9186-fd070471083f"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 14 20:33:45.099884 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.099870 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa80d85-f100-438f-9186-fd070471083f-kube-api-access-c8kh4" (OuterVolumeSpecName: "kube-api-access-c8kh4") pod "9fa80d85-f100-438f-9186-fd070471083f" (UID: "9fa80d85-f100-438f-9186-fd070471083f"). InnerVolumeSpecName "kube-api-access-c8kh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:33:45.198672 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.198590 2566 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9fa80d85-f100-438f-9186-fd070471083f-tls-cert\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:33:45.198672 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.198620 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8kh4\" (UniqueName: \"kubernetes.io/projected/9fa80d85-f100-438f-9186-fd070471083f-kube-api-access-c8kh4\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:33:45.278082 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.278058 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:45.400810 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.400777 2566 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cb4hs\" (UniqueName: \"kubernetes.io/projected/b76165cf-05d2-4857-ada9-5050ddceaf0f-kube-api-access-cb4hs\") pod \"b76165cf-05d2-4857-ada9-5050ddceaf0f\" (UID: \"b76165cf-05d2-4857-ada9-5050ddceaf0f\") " Jul 14 20:33:45.402911 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.402881 2566 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b76165cf-05d2-4857-ada9-5050ddceaf0f-kube-api-access-cb4hs" (OuterVolumeSpecName: "kube-api-access-cb4hs") pod "b76165cf-05d2-4857-ada9-5050ddceaf0f" (UID: "b76165cf-05d2-4857-ada9-5050ddceaf0f"). InnerVolumeSpecName "kube-api-access-cb4hs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 14 20:33:45.501940 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:45.501854 2566 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cb4hs\" (UniqueName: \"kubernetes.io/projected/b76165cf-05d2-4857-ada9-5050ddceaf0f-kube-api-access-cb4hs\") on node \"ip-10-0-135-189.ec2.internal\" DevicePath \"\"" Jul 14 20:33:46.039863 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.039828 2566 generic.go:356] "Generic (PLEG): container finished" podID="b76165cf-05d2-4857-ada9-5050ddceaf0f" containerID="5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656" exitCode=0 Jul 14 20:33:46.040060 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.039875 2566 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-hj45v" Jul 14 20:33:46.040060 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.039910 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hj45v" event={"ID":"b76165cf-05d2-4857-ada9-5050ddceaf0f","Type":"ContainerDied","Data":"5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656"} Jul 14 20:33:46.040060 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.039973 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-hj45v" event={"ID":"b76165cf-05d2-4857-ada9-5050ddceaf0f","Type":"ContainerDied","Data":"b189a40fc272df5b44755277575cdb18ee60059092908ac7c4fa8fcaf99b8a2e"} Jul 14 20:33:46.040060 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.039986 2566 scope.go:117] "RemoveContainer" containerID="5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656" Jul 14 20:33:46.040060 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.040002 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-n52nw" Jul 14 20:33:46.049233 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.049214 2566 scope.go:117] "RemoveContainer" containerID="5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656" Jul 14 20:33:46.049479 ip-10-0-135-189 kubenswrapper[2566]: E0714 20:33:46.049462 2566 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656\": container with ID starting with 5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656 not found: ID does not exist" containerID="5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656" Jul 14 20:33:46.049546 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.049492 2566 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656"} err="failed to get container status \"5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656\": rpc error: code = NotFound desc = could not find container \"5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656\": container with ID starting with 5a98fae548890736ab6f727cd205a60323c3c5ae78e1a6082e548bf94eb36656 not found: ID does not exist" Jul 14 20:33:46.062035 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.062011 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hj45v"] Jul 14 20:33:46.065496 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.065473 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-hj45v"] Jul 14 20:33:46.084845 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.084821 2566 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-n52nw"] Jul 14 20:33:46.088289 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:46.088269 2566 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-n52nw"] Jul 14 20:33:48.003986 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:48.003942 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9fa80d85-f100-438f-9186-fd070471083f" path="/var/lib/kubelet/pods/9fa80d85-f100-438f-9186-fd070471083f/volumes" Jul 14 20:33:48.004386 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:33:48.004256 2566 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b76165cf-05d2-4857-ada9-5050ddceaf0f" path="/var/lib/kubelet/pods/b76165cf-05d2-4857-ada9-5050ddceaf0f/volumes" Jul 14 20:34:32.541698 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.541655 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:34:32.601605 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.601565 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-zwg6z"] Jul 14 20:34:32.601948 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.601935 2566 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b76165cf-05d2-4857-ada9-5050ddceaf0f" containerName="authorino" Jul 14 20:34:32.602027 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.601949 2566 state_mem.go:107] "Deleted CPUSet assignment" podUID="b76165cf-05d2-4857-ada9-5050ddceaf0f" containerName="authorino" Jul 14 20:34:32.602065 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.602034 2566 memory_manager.go:368] "RemoveStaleState removing state" podUID="b76165cf-05d2-4857-ada9-5050ddceaf0f" containerName="authorino" Jul 14 20:34:32.605411 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.605391 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.608173 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.608146 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-622ks\"" Jul 14 20:34:32.608683 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.608666 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 14 20:34:32.616535 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.616512 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-zwg6z"] Jul 14 20:34:32.737091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.737057 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xjtq\" (UniqueName: \"kubernetes.io/projected/891809a8-0969-489b-b60c-1a9027ae90b3-kube-api-access-5xjtq\") pod \"payload-processing-f9b8d9b9b-zwg6z\" (UID: \"891809a8-0969-489b-b60c-1a9027ae90b3\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.737091 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.737105 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/891809a8-0969-489b-b60c-1a9027ae90b3-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-zwg6z\" (UID: \"891809a8-0969-489b-b60c-1a9027ae90b3\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.838160 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.838128 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xjtq\" (UniqueName: \"kubernetes.io/projected/891809a8-0969-489b-b60c-1a9027ae90b3-kube-api-access-5xjtq\") pod \"payload-processing-f9b8d9b9b-zwg6z\" (UID: \"891809a8-0969-489b-b60c-1a9027ae90b3\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.838397 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.838175 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/891809a8-0969-489b-b60c-1a9027ae90b3-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-zwg6z\" (UID: \"891809a8-0969-489b-b60c-1a9027ae90b3\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.838918 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.838899 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/891809a8-0969-489b-b60c-1a9027ae90b3-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-zwg6z\" (UID: \"891809a8-0969-489b-b60c-1a9027ae90b3\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.847001 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.846951 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xjtq\" (UniqueName: \"kubernetes.io/projected/891809a8-0969-489b-b60c-1a9027ae90b3-kube-api-access-5xjtq\") pod \"payload-processing-f9b8d9b9b-zwg6z\" (UID: \"891809a8-0969-489b-b60c-1a9027ae90b3\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:32.916367 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:32.916326 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:33.053619 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:33.053589 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-zwg6z"] Jul 14 20:34:33.055920 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:34:33.055892 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod891809a8_0969_489b_b60c_1a9027ae90b3.slice/crio-4ebbc38f8dce51c36fb2134cc115638c06ac124e87caf6197a80bd356d8b6880 WatchSource:0}: Error finding container 4ebbc38f8dce51c36fb2134cc115638c06ac124e87caf6197a80bd356d8b6880: Status 404 returned error can't find the container with id 4ebbc38f8dce51c36fb2134cc115638c06ac124e87caf6197a80bd356d8b6880 Jul 14 20:34:33.290111 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:33.290019 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" event={"ID":"891809a8-0969-489b-b60c-1a9027ae90b3","Type":"ContainerStarted","Data":"4ebbc38f8dce51c36fb2134cc115638c06ac124e87caf6197a80bd356d8b6880"} Jul 14 20:34:35.310975 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:35.310933 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" event={"ID":"891809a8-0969-489b-b60c-1a9027ae90b3","Type":"ContainerStarted","Data":"df99bcef8a13a9243e6b52baf56d835da1b338c7a796d4f0455a7ce7cd11024d"} Jul 14 20:34:35.311406 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:35.311053 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:35.329677 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:35.329625 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" podStartSLOduration=1.856882991 podStartE2EDuration="3.329608761s" totalImagesPullingTime="1.47272577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:34:35.327283209 +0000 UTC m=+741.895399188" watchObservedRunningTime="2026-07-14 20:34:35.329608761 +0000 UTC m=+741.897724776" Jul 14 20:34:46.318368 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:46.318337 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-zwg6z" Jul 14 20:34:54.701143 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:34:54.701104 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:35:03.390242 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:35:03.390201 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:35:21.075792 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:35:21.075755 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:35:25.872010 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:35:25.871977 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:35:40.988488 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:35:40.988407 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:35:53.589286 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:35:53.589251 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:37:01.049423 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.049386 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7cc94c7554-q7wvb"] Jul 14 20:37:01.051739 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.051720 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.053941 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.053917 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-5w2cd\"" Jul 14 20:37:01.054447 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.054428 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 14 20:37:01.063730 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.063707 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cc94c7554-q7wvb"] Jul 14 20:37:01.163808 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.163780 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56de33b6-47e1-40fe-ae16-85a98d564391-tls-cert\") pod \"authorino-7cc94c7554-q7wvb\" (UID: \"56de33b6-47e1-40fe-ae16-85a98d564391\") " pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.164008 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.163827 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pj6rg\" (UniqueName: \"kubernetes.io/projected/56de33b6-47e1-40fe-ae16-85a98d564391-kube-api-access-pj6rg\") pod \"authorino-7cc94c7554-q7wvb\" (UID: \"56de33b6-47e1-40fe-ae16-85a98d564391\") " pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.264950 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.264913 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pj6rg\" (UniqueName: \"kubernetes.io/projected/56de33b6-47e1-40fe-ae16-85a98d564391-kube-api-access-pj6rg\") pod \"authorino-7cc94c7554-q7wvb\" (UID: \"56de33b6-47e1-40fe-ae16-85a98d564391\") " pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.265214 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.265040 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56de33b6-47e1-40fe-ae16-85a98d564391-tls-cert\") pod \"authorino-7cc94c7554-q7wvb\" (UID: \"56de33b6-47e1-40fe-ae16-85a98d564391\") " pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.267374 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.267351 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/56de33b6-47e1-40fe-ae16-85a98d564391-tls-cert\") pod \"authorino-7cc94c7554-q7wvb\" (UID: \"56de33b6-47e1-40fe-ae16-85a98d564391\") " pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.273090 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.273067 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pj6rg\" (UniqueName: \"kubernetes.io/projected/56de33b6-47e1-40fe-ae16-85a98d564391-kube-api-access-pj6rg\") pod \"authorino-7cc94c7554-q7wvb\" (UID: \"56de33b6-47e1-40fe-ae16-85a98d564391\") " pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.386472 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.386391 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7cc94c7554-q7wvb" Jul 14 20:37:01.525623 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:01.525591 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7cc94c7554-q7wvb"] Jul 14 20:37:01.528030 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:37:01.528001 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod56de33b6_47e1_40fe_ae16_85a98d564391.slice/crio-e0b1ea4941eeb4482ac484f8ba11280964fd5a88bc8af029519f2da27b48d320 WatchSource:0}: Error finding container e0b1ea4941eeb4482ac484f8ba11280964fd5a88bc8af029519f2da27b48d320: Status 404 returned error can't find the container with id e0b1ea4941eeb4482ac484f8ba11280964fd5a88bc8af029519f2da27b48d320 Jul 14 20:37:02.095810 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:02.095751 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc94c7554-q7wvb" event={"ID":"56de33b6-47e1-40fe-ae16-85a98d564391","Type":"ContainerStarted","Data":"e8a2e71e8f2cdd2ba51f61bbbb676a586fc108149ca52ff3d3849b38d3c93fba"} Jul 14 20:37:02.096218 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:02.095822 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7cc94c7554-q7wvb" event={"ID":"56de33b6-47e1-40fe-ae16-85a98d564391","Type":"ContainerStarted","Data":"e0b1ea4941eeb4482ac484f8ba11280964fd5a88bc8af029519f2da27b48d320"} Jul 14 20:37:02.115616 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:02.115561 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7cc94c7554-q7wvb" podStartSLOduration=0.672991847 podStartE2EDuration="1.115534637s" totalImagesPullingTime="442.54279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:37:02.112065528 +0000 UTC m=+888.680181506" watchObservedRunningTime="2026-07-14 20:37:02.115534637 +0000 UTC m=+888.683650595" Jul 14 20:37:13.924559 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:13.924476 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:37:13.925419 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:13.925399 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:37:13.930944 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:13.930928 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:37:13.931854 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:37:13.931834 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:40:02.978684 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:40:02.978642 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:40:12.278269 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:40:12.278066 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:40:24.080419 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:40:24.080383 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:40:33.182486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:40:33.182449 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:40:43.772419 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:40:43.772382 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:41:10.573974 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:41:10.573931 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:41:22.771844 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:41:22.771809 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-f97w2"] Jul 14 20:41:59.702139 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:41:59.702097 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cc94c7554-q7wvb_56de33b6-47e1-40fe-ae16-85a98d564391/authorino/0.log" Jul 14 20:42:06.024889 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:06.024854 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-fh7sb_f6acbac2-ea70-4bf3-92a1-221de360431f/manager/0.log" Jul 14 20:42:06.030676 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:06.030654 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-fh7sb_f6acbac2-ea70-4bf3-92a1-221de360431f/copy-manifests/0.log" Jul 14 20:42:07.369490 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.369463 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw_c8de3fc9-d2f4-4fb6-93ae-eb028d90666e/util/0.log" Jul 14 20:42:07.376124 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.376076 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw_c8de3fc9-d2f4-4fb6-93ae-eb028d90666e/pull/0.log" Jul 14 20:42:07.382393 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.382372 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw_c8de3fc9-d2f4-4fb6-93ae-eb028d90666e/extract/0.log" Jul 14 20:42:07.498748 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.498727 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf_82ea08c8-3452-4afa-9d81-686f7a9916f9/util/0.log" Jul 14 20:42:07.504732 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.504711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf_82ea08c8-3452-4afa-9d81-686f7a9916f9/pull/0.log" Jul 14 20:42:07.510249 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.510227 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf_82ea08c8-3452-4afa-9d81-686f7a9916f9/extract/0.log" Jul 14 20:42:07.627341 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.627261 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2_d9f2b153-0254-4f21-a99a-e563669025cc/util/0.log" Jul 14 20:42:07.633671 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.633646 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2_d9f2b153-0254-4f21-a99a-e563669025cc/pull/0.log" Jul 14 20:42:07.638998 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.638972 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2_d9f2b153-0254-4f21-a99a-e563669025cc/extract/0.log" Jul 14 20:42:07.756776 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.756748 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd_09adec61-4e76-4ac2-a6d6-fcf5230d8e51/extract/0.log" Jul 14 20:42:07.763304 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.763281 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd_09adec61-4e76-4ac2-a6d6-fcf5230d8e51/util/0.log" Jul 14 20:42:07.769919 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.769892 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd_09adec61-4e76-4ac2-a6d6-fcf5230d8e51/pull/0.log" Jul 14 20:42:07.899225 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:07.899121 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cc94c7554-q7wvb_56de33b6-47e1-40fe-ae16-85a98d564391/authorino/0.log" Jul 14 20:42:08.273945 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:08.273863 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-72pvl_444bddfa-b3b7-4df8-bb6e-103ab866406e/kuadrant-console-plugin/0.log" Jul 14 20:42:08.685487 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:08.685459 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f97w2_6b6ae161-187b-4acc-abc4-1bb84b3df6ed/limitador/0.log" Jul 14 20:42:09.529232 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:09.529202 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-zd5zl_9fa7bf6c-8213-43f1-91af-d737a332890d/kube-auth-proxy/0.log" Jul 14 20:42:09.906009 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:09.905977 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwg6z_891809a8-0969-489b-b60c-1a9027ae90b3/payload-processing/0.log" Jul 14 20:42:10.027915 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:10.027885 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78b47967f6-8lb62_5f9692de-108f-4a8c-a734-a8fb6014a7cc/router/0.log" Jul 14 20:42:13.963110 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:13.963080 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:42:13.965305 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:13.965281 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:42:13.969306 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:13.969287 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:42:13.971321 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:13.971303 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-jnqj5_355ba4c6-c56a-4ccf-a51c-8825b94a8525/ovn-acl-logging/0.log" Jul 14 20:42:15.357605 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.357572 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7rsc/must-gather-dz8ff"] Jul 14 20:42:15.361307 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.361287 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.363292 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.363269 2566 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-k7rsc\"/\"default-dockercfg-cqb4f\"" Jul 14 20:42:15.363409 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.363271 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7rsc\"/\"openshift-service-ca.crt\"" Jul 14 20:42:15.363409 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.363368 2566 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-k7rsc\"/\"kube-root-ca.crt\"" Jul 14 20:42:15.371214 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.371186 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7rsc/must-gather-dz8ff"] Jul 14 20:42:15.395640 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.395602 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6z4m7\" (UniqueName: \"kubernetes.io/projected/be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b-kube-api-access-6z4m7\") pod \"must-gather-dz8ff\" (UID: \"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b\") " pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.395800 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.395676 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b-must-gather-output\") pod \"must-gather-dz8ff\" (UID: \"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b\") " pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.497207 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.497170 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6z4m7\" (UniqueName: \"kubernetes.io/projected/be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b-kube-api-access-6z4m7\") pod \"must-gather-dz8ff\" (UID: \"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b\") " pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.497388 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.497265 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b-must-gather-output\") pod \"must-gather-dz8ff\" (UID: \"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b\") " pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.497668 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.497646 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b-must-gather-output\") pod \"must-gather-dz8ff\" (UID: \"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b\") " pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.505452 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.505420 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6z4m7\" (UniqueName: \"kubernetes.io/projected/be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b-kube-api-access-6z4m7\") pod \"must-gather-dz8ff\" (UID: \"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b\") " pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.672010 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.671897 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7rsc/must-gather-dz8ff" Jul 14 20:42:15.811791 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.811765 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7rsc/must-gather-dz8ff"] Jul 14 20:42:15.813977 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:42:15.813924 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe6e8ac5_5dcf_45b4_a58d_4e8a2f3d794b.slice/crio-e894ddefd9e42f567399537a585f3a050634ff94cffc3472d8dafdd9155cfc26 WatchSource:0}: Error finding container e894ddefd9e42f567399537a585f3a050634ff94cffc3472d8dafdd9155cfc26: Status 404 returned error can't find the container with id e894ddefd9e42f567399537a585f3a050634ff94cffc3472d8dafdd9155cfc26 Jul 14 20:42:15.815780 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:15.815764 2566 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 14 20:42:16.753753 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:16.753708 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/must-gather-dz8ff" event={"ID":"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b","Type":"ContainerStarted","Data":"1b0fd8305a288379f9b6ee065d50f25bb2ba412571fa32c4d0accfa59ae7f380"} Jul 14 20:42:16.754246 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:16.753771 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/must-gather-dz8ff" event={"ID":"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b","Type":"ContainerStarted","Data":"e894ddefd9e42f567399537a585f3a050634ff94cffc3472d8dafdd9155cfc26"} Jul 14 20:42:17.766522 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:17.766469 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/must-gather-dz8ff" event={"ID":"be6e8ac5-5dcf-45b4-a58d-4e8a2f3d794b","Type":"ContainerStarted","Data":"c052318cac86414fe5773b18890ef2fbac3d551a1fee44edbccb20b31f563d00"} Jul 14 20:42:17.783158 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:17.783090 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7rsc/must-gather-dz8ff" podStartSLOduration=1.9737061790000001 podStartE2EDuration="2.783068797s" totalImagesPullingTime="809.362618ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-14 20:42:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:42:17.780415189 +0000 UTC m=+1204.348531167" watchObservedRunningTime="2026-07-14 20:42:17.783068797 +0000 UTC m=+1204.351184775" Jul 14 20:42:18.218742 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:18.218711 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-q97sn_27a6cb5c-dfe0-4f10-b8b1-7f58739f0776/global-pull-secret-syncer/0.log" Jul 14 20:42:18.381086 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:18.381052 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l4kgr_bfbc6f13-4505-4774-b7bd-0890208dc0fe/konnectivity-agent/0.log" Jul 14 20:42:18.423620 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:18.423587 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-189.ec2.internal_26aa8f6b915985464c3fef79af344d3c/haproxy/0.log" Jul 14 20:42:22.961282 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:22.961250 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw_c8de3fc9-d2f4-4fb6-93ae-eb028d90666e/extract/0.log" Jul 14 20:42:22.992382 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:22.992354 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw_c8de3fc9-d2f4-4fb6-93ae-eb028d90666e/util/0.log" Jul 14 20:42:23.015481 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.015455 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759lmvtw_c8de3fc9-d2f4-4fb6-93ae-eb028d90666e/pull/0.log" Jul 14 20:42:23.048429 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.048395 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf_82ea08c8-3452-4afa-9d81-686f7a9916f9/extract/0.log" Jul 14 20:42:23.070242 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.070212 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf_82ea08c8-3452-4afa-9d81-686f7a9916f9/util/0.log" Jul 14 20:42:23.094649 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.094616 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0swkdf_82ea08c8-3452-4afa-9d81-686f7a9916f9/pull/0.log" Jul 14 20:42:23.126480 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.126427 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2_d9f2b153-0254-4f21-a99a-e563669025cc/extract/0.log" Jul 14 20:42:23.160236 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.160205 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2_d9f2b153-0254-4f21-a99a-e563669025cc/util/0.log" Jul 14 20:42:23.190210 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.190175 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73c8wr2_d9f2b153-0254-4f21-a99a-e563669025cc/pull/0.log" Jul 14 20:42:23.220984 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.220869 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd_09adec61-4e76-4ac2-a6d6-fcf5230d8e51/extract/0.log" Jul 14 20:42:23.248830 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.248798 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd_09adec61-4e76-4ac2-a6d6-fcf5230d8e51/util/0.log" Jul 14 20:42:23.276102 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.276074 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1ds8kd_09adec61-4e76-4ac2-a6d6-fcf5230d8e51/pull/0.log" Jul 14 20:42:23.372486 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.372450 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7cc94c7554-q7wvb_56de33b6-47e1-40fe-ae16-85a98d564391/authorino/0.log" Jul 14 20:42:23.489199 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.489108 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-72pvl_444bddfa-b3b7-4df8-bb6e-103ab866406e/kuadrant-console-plugin/0.log" Jul 14 20:42:23.651264 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:23.651239 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-f97w2_6b6ae161-187b-4acc-abc4-1bb84b3df6ed/limitador/0.log" Jul 14 20:42:25.355023 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.354990 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/alertmanager/0.log" Jul 14 20:42:25.382397 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.382351 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/config-reloader/0.log" Jul 14 20:42:25.409243 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.409212 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/kube-rbac-proxy-web/0.log" Jul 14 20:42:25.434891 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.434865 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/kube-rbac-proxy/0.log" Jul 14 20:42:25.458941 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.458916 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/kube-rbac-proxy-metric/0.log" Jul 14 20:42:25.488140 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.487999 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/prom-label-proxy/0.log" Jul 14 20:42:25.523188 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.523157 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a9df7b39-89b6-4b83-b006-f6b437c85fa7/init-config-reloader/0.log" Jul 14 20:42:25.561385 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.561352 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-6l28p_2f20ab00-ed02-408e-a706-676ccfc2fc38/cluster-monitoring-operator/0.log" Jul 14 20:42:25.592507 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.592475 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z4g55_9cf985c7-74dd-420b-a387-dbb01ab8d6f3/kube-state-metrics/0.log" Jul 14 20:42:25.615329 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.615259 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z4g55_9cf985c7-74dd-420b-a387-dbb01ab8d6f3/kube-rbac-proxy-main/0.log" Jul 14 20:42:25.650558 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.650496 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-z4g55_9cf985c7-74dd-420b-a387-dbb01ab8d6f3/kube-rbac-proxy-self/0.log" Jul 14 20:42:25.756203 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.756088 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-2k6rc_ad7274e1-c673-4113-a95a-e8e37584fb41/monitoring-plugin/0.log" Jul 14 20:42:25.794013 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.793985 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7qr9_904d90a9-f475-4753-b8a5-5949fea88a8f/node-exporter/0.log" Jul 14 20:42:25.821084 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.821059 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7qr9_904d90a9-f475-4753-b8a5-5949fea88a8f/kube-rbac-proxy/0.log" Jul 14 20:42:25.846453 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:25.846421 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m7qr9_904d90a9-f475-4753-b8a5-5949fea88a8f/init-textfile/0.log" Jul 14 20:42:26.301734 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.301703 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xjlkb_6046b010-5469-41cc-aa57-80a1c49b345d/prometheus-operator/0.log" Jul 14 20:42:26.324262 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.324229 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-xjlkb_6046b010-5469-41cc-aa57-80a1c49b345d/kube-rbac-proxy/0.log" Jul 14 20:42:26.470494 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.470463 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7565d97bcf-qhf7c_a8867fc3-6a27-4270-af7f-eb4f92287667/thanos-query/0.log" Jul 14 20:42:26.494577 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.494545 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7565d97bcf-qhf7c_a8867fc3-6a27-4270-af7f-eb4f92287667/kube-rbac-proxy-web/0.log" Jul 14 20:42:26.515746 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.515708 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7565d97bcf-qhf7c_a8867fc3-6a27-4270-af7f-eb4f92287667/kube-rbac-proxy/0.log" Jul 14 20:42:26.541651 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.541626 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7565d97bcf-qhf7c_a8867fc3-6a27-4270-af7f-eb4f92287667/prom-label-proxy/0.log" Jul 14 20:42:26.570153 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.569856 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7565d97bcf-qhf7c_a8867fc3-6a27-4270-af7f-eb4f92287667/kube-rbac-proxy-rules/0.log" Jul 14 20:42:26.593848 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:26.593821 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7565d97bcf-qhf7c_a8867fc3-6a27-4270-af7f-eb4f92287667/kube-rbac-proxy-metrics/0.log" Jul 14 20:42:27.793417 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:27.793384 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-kk8gz_c122e606-daba-4981-b063-721bdaad6564/networking-console-plugin/0.log" Jul 14 20:42:28.406300 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.406267 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/1.log" Jul 14 20:42:28.416744 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.416716 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-rt2pp_99b24900-fe71-4aed-a29c-087896ece95d/console-operator/2.log" Jul 14 20:42:28.836210 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.836178 2566 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m"] Jul 14 20:42:28.843444 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.841910 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:28.852047 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.851981 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m"] Jul 14 20:42:28.942866 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.942824 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nr7bx\" (UniqueName: \"kubernetes.io/projected/210f30f9-2c07-4013-a0c6-33ccbe15a522-kube-api-access-nr7bx\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:28.943078 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.943031 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-sys\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:28.943193 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.943160 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-podres\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:28.943453 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.943434 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-proc\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:28.943665 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.943620 2566 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-lib-modules\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:28.991882 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:28.991853 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c56bb569c-bvsl4_31dd8beb-61a0-4887-9f83-cc716e0c322e/console/0.log" Jul 14 20:42:29.026206 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.026172 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-d5tww_c4359acd-2829-4e52-a956-91c0b6865ed0/download-server/0.log" Jul 14 20:42:29.044443 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044405 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nr7bx\" (UniqueName: \"kubernetes.io/projected/210f30f9-2c07-4013-a0c6-33ccbe15a522-kube-api-access-nr7bx\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044495 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-sys\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044542 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-podres\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044569 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-proc\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044594 2566 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-lib-modules\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044655 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044597 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-sys\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044896 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044706 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-proc\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044896 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044709 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-lib-modules\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.044896 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.044707 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/210f30f9-2c07-4013-a0c6-33ccbe15a522-podres\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.054414 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.053801 2566 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nr7bx\" (UniqueName: \"kubernetes.io/projected/210f30f9-2c07-4013-a0c6-33ccbe15a522-kube-api-access-nr7bx\") pod \"perf-node-gather-daemonset-rsp2m\" (UID: \"210f30f9-2c07-4013-a0c6-33ccbe15a522\") " pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.157708 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.157622 2566 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.315598 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.315433 2566 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m"] Jul 14 20:42:29.319531 ip-10-0-135-189 kubenswrapper[2566]: W0714 20:42:29.319496 2566 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod210f30f9_2c07_4013_a0c6_33ccbe15a522.slice/crio-bf1065ca38ef462b2a3cb7d269d1d41ef58dada496315260ada902f85fdafe6a WatchSource:0}: Error finding container bf1065ca38ef462b2a3cb7d269d1d41ef58dada496315260ada902f85fdafe6a: Status 404 returned error can't find the container with id bf1065ca38ef462b2a3cb7d269d1d41ef58dada496315260ada902f85fdafe6a Jul 14 20:42:29.640508 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.640467 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-lkdjc_ae2d504e-abed-4a83-92c3-352bf9c436ea/volume-data-source-validator/0.log" Jul 14 20:42:29.871476 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.871433 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" event={"ID":"210f30f9-2c07-4013-a0c6-33ccbe15a522","Type":"ContainerStarted","Data":"8935d8a14b0ee5cc16b0231347dd9ba066c81988b543321628c60df53af57588"} Jul 14 20:42:29.871873 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.871493 2566 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" event={"ID":"210f30f9-2c07-4013-a0c6-33ccbe15a522","Type":"ContainerStarted","Data":"bf1065ca38ef462b2a3cb7d269d1d41ef58dada496315260ada902f85fdafe6a"} Jul 14 20:42:29.871873 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.871524 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:29.890114 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:29.890059 2566 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" podStartSLOduration=1.890037709 podStartE2EDuration="1.890037709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-14 20:42:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-14 20:42:29.888258419 +0000 UTC m=+1216.456374403" watchObservedRunningTime="2026-07-14 20:42:29.890037709 +0000 UTC m=+1216.458153686" Jul 14 20:42:30.867890 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:30.867857 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8snf_b3ecf8fa-fd1c-472c-8336-706a8f92fab7/dns/0.log" Jul 14 20:42:30.892799 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:30.892771 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n8snf_b3ecf8fa-fd1c-472c-8336-706a8f92fab7/kube-rbac-proxy/0.log" Jul 14 20:42:30.921208 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:30.921182 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-946bq_9dafb0b0-ceaa-478c-888e-14bf94c8eb00/dns-node-resolver/0.log" Jul 14 20:42:31.574688 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:31.574661 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mr9tb_01c6eacb-abb9-4785-8b13-85d283cb56e9/node-ca/0.log" Jul 14 20:42:32.677418 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:32.677386 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-zd5zl_9fa7bf6c-8213-43f1-91af-d737a332890d/kube-auth-proxy/0.log" Jul 14 20:42:32.776802 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:32.776772 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwg6z_891809a8-0969-489b-b60c-1a9027ae90b3/payload-processing/0.log" Jul 14 20:42:32.813196 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:32.813167 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78b47967f6-8lb62_5f9692de-108f-4a8c-a734-a8fb6014a7cc/router/0.log" Jul 14 20:42:33.459835 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:33.459799 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7kz89_84644784-a141-4dda-b4e1-089ed1b2e26b/serve-healthcheck-canary/0.log" Jul 14 20:42:34.038149 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:34.038115 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27hwc_02ebf343-fa4c-47d2-831e-14993565d579/kube-rbac-proxy/0.log" Jul 14 20:42:34.061472 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:34.061445 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27hwc_02ebf343-fa4c-47d2-831e-14993565d579/exporter/0.log" Jul 14 20:42:34.087987 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:34.087943 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-27hwc_02ebf343-fa4c-47d2-831e-14993565d579/extractor/0.log" Jul 14 20:42:35.892160 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:35.892129 2566 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-k7rsc/perf-node-gather-daemonset-rsp2m" Jul 14 20:42:36.643800 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:36.643770 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-fh7sb_f6acbac2-ea70-4bf3-92a1-221de360431f/manager/0.log" Jul 14 20:42:36.664284 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:36.664257 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-79d49c7b87-fh7sb_f6acbac2-ea70-4bf3-92a1-221de360431f/copy-manifests/0.log" Jul 14 20:42:37.969563 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:37.969536 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-78b47f4478-8bxck_83f74421-eda2-4cfe-b358-9a5c63cb16d2/manager/0.log" Jul 14 20:42:38.945467 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:38.945383 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-zd5zl_9fa7bf6c-8213-43f1-91af-d737a332890d/kube-auth-proxy/0.log" Jul 14 20:42:39.011570 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:39.011535 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwg6z_891809a8-0969-489b-b60c-1a9027ae90b3/payload-processing/0.log" Jul 14 20:42:39.027825 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:39.027796 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78b47967f6-8lb62_5f9692de-108f-4a8c-a734-a8fb6014a7cc/router/0.log" Jul 14 20:42:40.218600 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:40.218566 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75fb49cfc4-zd5zl_9fa7bf6c-8213-43f1-91af-d737a332890d/kube-auth-proxy/0.log" Jul 14 20:42:40.297582 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:40.297546 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-zwg6z_891809a8-0969-489b-b60c-1a9027ae90b3/payload-processing/0.log" Jul 14 20:42:40.319333 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:40.319299 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-78b47967f6-8lb62_5f9692de-108f-4a8c-a734-a8fb6014a7cc/router/0.log" Jul 14 20:42:43.683413 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:43.683381 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wg8n5_d1f56ce6-a776-4d87-bac9-651b9fbee27c/kube-storage-version-migrator-operator/1.log" Jul 14 20:42:43.685052 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:43.685026 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-wg8n5_d1f56ce6-a776-4d87-bac9-651b9fbee27c/kube-storage-version-migrator-operator/0.log" Jul 14 20:42:44.747217 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:44.747182 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-2gsg6_d27bc421-3505-4d69-883c-d4d0d5290e4f/kube-multus/0.log" Jul 14 20:42:44.978305 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:44.978271 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/kube-multus-additional-cni-plugins/0.log" Jul 14 20:42:45.001451 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.001371 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/egress-router-binary-copy/0.log" Jul 14 20:42:45.021669 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.021638 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/cni-plugins/0.log" Jul 14 20:42:45.041707 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.041677 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/bond-cni-plugin/0.log" Jul 14 20:42:45.062339 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.062302 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/routeoverride-cni/0.log" Jul 14 20:42:45.080927 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.080899 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/whereabouts-cni-bincopy/0.log" Jul 14 20:42:45.103694 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.103669 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-k2x4n_34345adb-3cba-4076-806a-0dcf148e23f2/whereabouts-cni/0.log" Jul 14 20:42:45.374940 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.374904 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r9mdm_941f6ef3-8ea0-4657-8b97-91ce535dc8ab/network-metrics-daemon/0.log" Jul 14 20:42:45.394569 ip-10-0-135-189 kubenswrapper[2566]: I0714 20:42:45.394542 2566 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r9mdm_941f6ef3-8ea0-4657-8b97-91ce535dc8ab/kube-rbac-proxy/0.log"