Jul 09 14:00:35.267105 ip-10-0-134-157 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 14:00:35.267117 ip-10-0-134-157 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 14:00:35.267124 ip-10-0-134-157 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 14:00:35.267344 ip-10-0-134-157 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 14:00:45.391056 ip-10-0-134-157 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 14:00:45.391073 ip-10-0-134-157 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot bb2c1faa2ef8420aab3075e0beeaedfa -- Jul 09 14:02:47.055310 ip-10-0-134-157 systemd[1]: Starting Kubernetes Kubelet... Jul 09 14:02:47.475307 ip-10-0-134-157 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:02:47.475307 ip-10-0-134-157 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 14:02:47.475307 ip-10-0-134-157 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:02:47.475307 ip-10-0-134-157 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 14:02:47.475307 ip-10-0-134-157 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 14:02:47.477335 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.477222 2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 14:02:47.481551 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481537 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481553 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481558 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481562 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481566 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481569 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481572 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481575 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481577 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481582 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481584 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481587 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481590 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481592 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:47.481589 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481595 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481599 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481602 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481604 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481607 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481610 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481613 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481615 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481618 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481620 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481623 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481626 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481628 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481631 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481633 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481636 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481638 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481641 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481643 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:47.481911 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481646 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481648 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481651 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481653 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481658 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481661 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481664 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481667 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481671 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481673 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481676 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481679 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481682 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481684 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481687 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481691 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481694 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481697 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481699 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481702 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:47.482402 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481704 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481707 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481710 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481712 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481715 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481717 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481720 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481722 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481725 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481728 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481730 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481732 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481735 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481738 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481740 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481743 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481745 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481748 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481750 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481753 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:47.483080 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481755 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481761 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481763 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481766 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481769 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481771 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481774 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481777 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481780 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481783 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481785 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481788 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481791 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481794 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481796 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481799 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481801 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481804 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481806 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:47.483877 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481809 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481813 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481816 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481819 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481822 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481825 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.481828 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483477 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483498 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483505 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483511 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483515 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483526 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483532 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483536 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483541 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483546 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483550 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483555 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:47.484514 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483570 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483575 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483579 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483682 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483690 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483696 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483707 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483712 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483716 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483721 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483725 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483730 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483734 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483740 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483744 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483749 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483753 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483757 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483768 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483772 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:47.484992 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483779 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483789 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483794 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483799 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483807 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483813 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483853 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483866 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483872 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483878 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483884 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483890 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483895 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483899 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483906 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483911 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483916 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483921 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483930 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:47.485554 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483934 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.483974 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484025 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484158 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484162 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484165 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484168 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484171 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484174 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484177 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484180 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484184 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484188 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484191 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484194 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484197 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484200 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484203 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484206 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:47.486022 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484209 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484211 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484214 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484217 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484220 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484222 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484225 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484227 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484230 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484233 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484237 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484240 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484242 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484245 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484247 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484250 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484253 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484256 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484259 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484261 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:47.486475 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484265 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484268 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484271 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484273 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484276 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484279 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484281 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484284 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484287 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484715 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484721 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484724 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484727 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484730 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484733 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484736 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484739 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484741 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484744 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484746 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:47.486984 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484749 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484751 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484754 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484757 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484759 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484761 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484764 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484766 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484769 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484771 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484774 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484776 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484779 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484782 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484793 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484796 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484799 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484803 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484805 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:47.487799 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484809 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484813 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484816 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484818 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484821 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484824 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484827 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484830 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484832 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484835 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484838 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484841 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484843 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484845 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484848 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484850 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484853 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484855 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484858 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484860 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:47.488320 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484863 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484866 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484869 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484871 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484874 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484876 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484879 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484882 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484884 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484887 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484889 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484892 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484894 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484897 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484900 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484902 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484905 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484907 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484910 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484913 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:47.488826 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484915 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484918 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484920 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484923 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484925 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484928 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484930 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484932 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484935 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484937 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484940 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484942 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484945 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484947 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484950 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484952 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484954 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484957 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484960 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:47.489364 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484964 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484968 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484971 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484974 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484977 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484979 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484982 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484986 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484990 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.484992 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485082 2556 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485089 2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485095 2556 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485099 2556 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485103 2556 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485106 2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485110 2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485114 2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485117 2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485120 2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485123 2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 14:02:47.489868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485127 2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485130 2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485133 2556 flags.go:64] FLAG: --cgroup-root="" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485136 2556 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485139 2556 flags.go:64] FLAG: --client-ca-file="" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485141 2556 flags.go:64] FLAG: --cloud-provider="external" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485145 2556 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485149 2556 flags.go:64] FLAG: --cluster-domain="" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485153 2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485156 2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485159 2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485165 2556 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485169 2556 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485172 2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485176 2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485179 2556 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485182 2556 flags.go:64] FLAG: --contention-profiling="false" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485185 2556 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485188 2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485192 2556 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485194 2556 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485199 2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485202 2556 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485204 2556 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485207 2556 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 14:02:47.490440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485210 2556 flags.go:64] FLAG: --enable-server="true" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485213 2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485217 2556 flags.go:64] FLAG: --event-burst="100" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485220 2556 flags.go:64] FLAG: --event-qps="50" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485223 2556 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485226 2556 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485229 2556 flags.go:64] FLAG: --eviction-hard="" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485233 2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485236 2556 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485239 2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485241 2556 flags.go:64] FLAG: --eviction-soft="" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485244 2556 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485247 2556 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485250 2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485253 2556 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485256 2556 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485260 2556 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485263 2556 flags.go:64] FLAG: --feature-gates="" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485268 2556 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485271 2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485274 2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485278 2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485281 2556 flags.go:64] FLAG: --healthz-port="10248" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485284 2556 flags.go:64] FLAG: --help="false" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485287 2556 flags.go:64] FLAG: --hostname-override="ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.491075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485290 2556 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485293 2556 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485296 2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485299 2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485302 2556 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485305 2556 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485307 2556 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485310 2556 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485313 2556 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485316 2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485319 2556 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485321 2556 flags.go:64] FLAG: --kube-reserved="" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485324 2556 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485327 2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485330 2556 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485333 2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485335 2556 flags.go:64] FLAG: --lock-file="" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485338 2556 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485341 2556 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485344 2556 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485349 2556 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485352 2556 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485355 2556 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 14:02:47.491741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485359 2556 flags.go:64] FLAG: --logging-format="text" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485363 2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485367 2556 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485370 2556 flags.go:64] FLAG: --manifest-url="" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485373 2556 flags.go:64] FLAG: --manifest-url-header="" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485377 2556 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485380 2556 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485384 2556 flags.go:64] FLAG: --max-pods="110" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485387 2556 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485390 2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485393 2556 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485396 2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485399 2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485402 2556 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485405 2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485412 2556 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485415 2556 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485418 2556 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485421 2556 flags.go:64] FLAG: --pod-cidr="" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485424 2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485430 2556 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485432 2556 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485435 2556 flags.go:64] FLAG: --pods-per-core="0" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485438 2556 flags.go:64] FLAG: --port="10250" Jul 09 14:02:47.492397 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485441 2556 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485444 2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-021455958f83779f0" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485447 2556 flags.go:64] FLAG: --qos-reserved="" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485450 2556 flags.go:64] FLAG: --read-only-port="10255" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485453 2556 flags.go:64] FLAG: --register-node="true" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485456 2556 flags.go:64] FLAG: --register-with-taints="" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485460 2556 flags.go:64] FLAG: --registry-burst="10" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485463 2556 flags.go:64] FLAG: --registry-qps="5" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485467 2556 flags.go:64] FLAG: --reserved-cpus="" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485470 2556 flags.go:64] FLAG: --reserved-memory="" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485474 2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485478 2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485481 2556 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485483 2556 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485487 2556 flags.go:64] FLAG: --runonce="false" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485489 2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485492 2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485495 2556 flags.go:64] FLAG: --seccomp-default="false" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485507 2556 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485510 2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485513 2556 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485516 2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485520 2556 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485522 2556 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485525 2556 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 14:02:47.493017 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485528 2556 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485531 2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485534 2556 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485537 2556 flags.go:64] FLAG: --system-cgroups="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485540 2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485545 2556 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485548 2556 flags.go:64] FLAG: --tls-cert-file="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485550 2556 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485555 2556 flags.go:64] FLAG: --tls-min-version="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485558 2556 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485561 2556 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485564 2556 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485567 2556 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485570 2556 flags.go:64] FLAG: --v="2" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485574 2556 flags.go:64] FLAG: --version="false" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485583 2556 flags.go:64] FLAG: --vmodule="" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485587 2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.485590 2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485714 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485719 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485723 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485726 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485728 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485731 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:47.493677 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485734 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485737 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485741 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485744 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485748 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485751 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485754 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485757 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485760 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485764 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485768 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485771 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485774 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485777 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485779 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485782 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485785 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485787 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485790 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:47.494350 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485792 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485795 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485797 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485800 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485804 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485807 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485810 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485814 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485817 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485820 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485822 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485825 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485827 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485830 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485833 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485835 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485838 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485840 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485843 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485845 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:47.494846 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485848 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485850 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485853 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485856 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485858 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485861 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485863 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485866 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485868 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485871 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485873 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485876 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485878 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485881 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485883 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485886 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485889 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485893 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485897 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:47.495521 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485901 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485904 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485907 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485910 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485912 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485915 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485918 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485920 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485923 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485925 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485928 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485930 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485933 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485936 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485938 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485941 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485943 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485946 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485948 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485951 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:47.496016 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485953 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485956 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485958 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485961 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485964 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485966 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485969 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485971 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485974 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485977 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485980 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485983 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485987 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485990 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.485993 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:47.496555 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.486524 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.493769 2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.493786 2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.493809 2556 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.493818 2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493878 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493884 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493887 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493891 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493895 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493898 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493901 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493904 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493907 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493910 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493913 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493916 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493919 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493922 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493925 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:47.496949 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493928 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493930 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493933 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493936 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493939 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493941 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493944 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493947 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493950 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493953 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493956 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493959 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493962 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493966 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493972 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493976 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493978 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493981 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493984 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:47.497491 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493987 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493990 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493993 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493996 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.493998 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494001 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494004 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494007 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494009 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494012 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494015 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494018 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494020 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494023 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494026 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494029 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494031 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494035 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494037 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494040 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:47.497995 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494044 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494048 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494052 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494055 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494058 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494061 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494066 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494070 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494073 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494077 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494080 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494104 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494108 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494110 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494113 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494116 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494119 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494122 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494125 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:47.498518 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494128 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494130 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494134 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494136 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494139 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494142 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494145 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494148 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494150 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494153 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494156 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494159 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494162 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494164 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494167 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494170 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494173 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494176 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494179 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494182 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:47.499014 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494184 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494187 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494190 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494193 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494196 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494199 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.494204 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494340 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494346 2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494349 2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494353 2556 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494356 2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494359 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494362 2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494365 2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 14:02:47.499544 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494368 2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494371 2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494374 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494376 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494379 2556 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494382 2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494385 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494387 2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494390 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494393 2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494396 2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494399 2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494402 2556 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494405 2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494408 2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494411 2556 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494414 2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494416 2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494419 2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494421 2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 14:02:47.499933 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494428 2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494431 2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494434 2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494438 2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494441 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494444 2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494447 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494450 2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494453 2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494456 2556 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494458 2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494461 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494464 2556 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494466 2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494469 2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494472 2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494475 2556 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494477 2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494480 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494483 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 14:02:47.500493 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494485 2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494488 2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494491 2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494494 2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494496 2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494501 2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494504 2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494507 2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494510 2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494513 2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494516 2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494519 2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494521 2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494525 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494528 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494531 2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494533 2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494536 2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494539 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 14:02:47.500999 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494542 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494545 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494547 2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494550 2556 feature_gate.go:328] unrecognized feature gate: Example Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494553 2556 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494556 2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494558 2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494561 2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494564 2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494566 2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494569 2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494572 2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494574 2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494577 2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494580 2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494583 2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494585 2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494588 2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494591 2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494595 2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 14:02:47.501549 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494598 2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494602 2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494605 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494608 2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494611 2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494614 2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494617 2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494620 2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494622 2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494625 2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494630 2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:47.494633 2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.494638 2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.494756 2556 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 14:02:47.502239 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.496943 2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 14:02:47.502623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.498342 2556 server.go:1019] "Starting client certificate rotation" Jul 09 14:02:47.502623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.498452 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:02:47.502623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.498495 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 14:02:47.502623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.501856 2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:02:47.503404 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.503386 2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 14:02:47.512094 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.512070 2556 log.go:25] "Validated CRI v1 runtime API" Jul 09 14:02:47.514421 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.514407 2556 log.go:25] "Validated CRI v1 image API" Jul 09 14:02:47.515327 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.515307 2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 14:02:47.520326 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.520307 2556 fs.go:135] Filesystem UUIDs: map[1a3305af-e01c-49ed-9904-ad9e27a2cd93:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f5a5d060-6ffd-4969-a73c-ca4f8fe894bc:/dev/nvme0n1p4] Jul 09 14:02:47.520388 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.520332 2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 14:02:47.527867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.527657 2556 manager.go:216] Machine: {Timestamp:2026-07-09 14:02:47.526351672 +0000 UTC m=+0.342761937 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098993 MemoryCapacity:33164488704 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec216d8c3ce754f21e225a79af12260a SystemUUID:ec216d8c-3ce7-54f2-1e22-5a79af12260a BootID:bb2c1faa-2ef8-420a-ab30-75e0beeaedfa Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:49:50:fa:4c:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:49:50:fa:4c:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:03:ec:1b:6e:4d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164488704 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 14:02:47.527867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.527844 2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 14:02:47.528004 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.527973 2556 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 14:02:47.530724 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.530704 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:02:47.531581 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.531554 2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 14:02:47.532362 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.531587 2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-157.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 14:02:47.532945 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.532932 2556 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 14:02:47.532998 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.532955 2556 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 14:02:47.532998 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.532969 2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:02:47.533750 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.533738 2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 14:02:47.535140 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.535128 2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 14:02:47.538415 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538400 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:02:47.538561 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538549 2556 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 14:02:47.538620 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538590 2556 kubelet.go:486] "Attempting to sync node with API server" Jul 09 14:02:47.538620 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538605 2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 14:02:47.538719 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538626 2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 14:02:47.538719 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538642 2556 kubelet.go:398] "Adding apiserver pod source" Jul 09 14:02:47.538719 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.538656 2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 14:02:47.539038 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.539024 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:02:47.539131 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.539049 2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 14:02:47.541567 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.541538 2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 14:02:47.543648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543632 2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 14:02:47.543713 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543665 2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 14:02:47.543896 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543885 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 14:02:47.543939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543901 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 14:02:47.543939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543907 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 14:02:47.543939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543913 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 14:02:47.543939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543922 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 14:02:47.543939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.543928 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 14:02:47.544780 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.544770 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 14:02:47.544780 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.544780 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 14:02:47.544844 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.544788 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 14:02:47.544844 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.544794 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 14:02:47.544844 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.544803 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 14:02:47.544844 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.544811 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 14:02:47.545550 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.545539 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 14:02:47.545550 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.545550 2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 14:02:47.548988 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.548955 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 14:02:47.549091 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.549002 2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-157.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 14:02:47.549149 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.549074 2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 14:02:47.549284 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.549270 2556 server.go:1268] "Started kubelet" Jul 09 14:02:47.549431 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.549366 2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 14:02:47.549532 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.549460 2556 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 14:02:47.549643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.549601 2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 14:02:47.550262 ip-10-0-134-157 systemd[1]: Started Kubernetes Kubelet. Jul 09 14:02:47.552201 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.552182 2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 14:02:47.552390 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.552368 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sbjvw" Jul 09 14:02:47.553231 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.553211 2556 server.go:310] "Adding debug handlers to kubelet server" Jul 09 14:02:47.555794 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.554681 2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-157.ec2.internal.18c0a3fee21c480d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-157.ec2.internal,UID:ip-10-0-134-157.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-157.ec2.internal,},FirstTimestamp:2026-07-09 14:02:47.549241357 +0000 UTC m=+0.365651623,LastTimestamp:2026-07-09 14:02:47.549241357 +0000 UTC m=+0.365651623,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-157.ec2.internal,}" Jul 09 14:02:47.558022 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.558004 2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 14:02:47.559393 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.559372 2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 14:02:47.559468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.559378 2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 14:02:47.559910 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.559885 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:47.560366 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.560344 2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 14:02:47.560585 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.560566 2556 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 14:02:47.560661 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.560590 2556 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 14:02:47.560857 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.560836 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sbjvw" Jul 09 14:02:47.560978 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.560881 2556 reconstruct.go:97] "Volume reconstruction finished" Jul 09 14:02:47.561072 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.561061 2556 reconciler.go:29] "Reconciler: start to sync state" Jul 09 14:02:47.561168 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.560973 2556 factory.go:55] Registering systemd factory Jul 09 14:02:47.561257 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.561247 2556 factory.go:223] Registration of the systemd container factory successfully Jul 09 14:02:47.562338 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.562303 2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-157.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 14:02:47.562439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.562371 2556 factory.go:153] Registering CRI-O factory Jul 09 14:02:47.562439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.562391 2556 factory.go:223] Registration of the crio container factory successfully Jul 09 14:02:47.562544 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.562470 2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 14:02:47.562544 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.562496 2556 factory.go:103] Registering Raw factory Jul 09 14:02:47.562544 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.562513 2556 manager.go:1196] Started watching for new ooms in manager Jul 09 14:02:47.563190 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.563164 2556 manager.go:349] Starting recovery of all containers Jul 09 14:02:47.574215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.574191 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:47.575111 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.575070 2556 manager.go:354] Recovery completed Jul 09 14:02:47.579410 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.579396 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.581235 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581221 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.581301 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581248 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.581301 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581260 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.581761 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581748 2556 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 14:02:47.581761 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581760 2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 14:02:47.581892 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581776 2556 state_mem.go:36] "Initialized new in-memory state store" Jul 09 14:02:47.581892 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.581820 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.582745 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.582730 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.582829 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.582759 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.582829 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.582773 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.582936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.582883 2556 policy_none.go:49] "None policy: Start" Jul 09 14:02:47.582936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.582901 2556 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 14:02:47.582936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.582916 2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 14:02:47.584061 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.584045 2556 policy_none.go:47] "Start" Jul 09 14:02:47.622773 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.622647 2556 manager.go:337] "Starting Device Plugin manager" Jul 09 14:02:47.622879 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.622788 2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 14:02:47.622879 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.622802 2556 server.go:87] "Starting device plugin registration server" Jul 09 14:02:47.623043 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.623031 2556 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 14:02:47.623083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.623045 2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 14:02:47.623138 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.623116 2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 14:02:47.623233 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.623217 2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 14:02:47.623342 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.623254 2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 14:02:47.624795 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.624778 2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 14:02:47.624861 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.624823 2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:47.724107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.724069 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.725184 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.725092 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.725184 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.725126 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.725184 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.725136 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.725184 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.725163 2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.734398 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.734356 2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.734398 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.734379 2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-157.ec2.internal\": node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:47.747749 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.747720 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 14:02:47.749120 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.749099 2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 14:02:47.749194 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.749141 2556 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 14:02:47.749194 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.749163 2556 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 14:02:47.749300 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.749199 2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 14:02:47.750046 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.750011 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:47.751278 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.751260 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:47.853180 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.853123 2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal"] Jul 09 14:02:47.853366 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.853231 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.853366 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.853141 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:47.854357 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.854335 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.854475 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.854373 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.854475 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.854384 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.855695 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.855682 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.855820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.855805 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.855856 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.855842 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.856474 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.856451 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.856580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.856486 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.856580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.856496 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.856580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.856503 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.856580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.856524 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.856788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.856604 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.857675 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.857659 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.857761 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.857684 2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 14:02:47.858321 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.858306 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientMemory" Jul 09 14:02:47.858408 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.858340 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 14:02:47.858408 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.858352 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeHasSufficientPID" Jul 09 14:02:47.862126 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.862102 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71787de8705105300f2e3e37e86beb98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal\" (UID: \"71787de8705105300f2e3e37e86beb98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.862215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.862148 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71787de8705105300f2e3e37e86beb98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal\" (UID: \"71787de8705105300f2e3e37e86beb98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.862215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.862174 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e41281165752ad9f9482a713a6ad085-config\") pod \"kube-apiserver-proxy-ip-10-0-134-157.ec2.internal\" (UID: \"7e41281165752ad9f9482a713a6ad085\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.874654 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.874635 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-157.ec2.internal\" not found" node="ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.880893 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.880874 2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-157.ec2.internal\" not found" node="ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.953665 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:47.953632 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:47.962751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.962729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71787de8705105300f2e3e37e86beb98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal\" (UID: \"71787de8705105300f2e3e37e86beb98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.962817 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.962757 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71787de8705105300f2e3e37e86beb98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal\" (UID: \"71787de8705105300f2e3e37e86beb98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.962817 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.962777 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e41281165752ad9f9482a713a6ad085-config\") pod \"kube-apiserver-proxy-ip-10-0-134-157.ec2.internal\" (UID: \"7e41281165752ad9f9482a713a6ad085\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.962893 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.962822 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7e41281165752ad9f9482a713a6ad085-config\") pod \"kube-apiserver-proxy-ip-10-0-134-157.ec2.internal\" (UID: \"7e41281165752ad9f9482a713a6ad085\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.962893 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.962838 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71787de8705105300f2e3e37e86beb98-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal\" (UID: \"71787de8705105300f2e3e37e86beb98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:47.962893 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:47.962846 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71787de8705105300f2e3e37e86beb98-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal\" (UID: \"71787de8705105300f2e3e37e86beb98\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:48.054606 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.054537 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.156533 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.156491 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.176466 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.176431 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:48.184214 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.184192 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" Jul 09 14:02:48.261075 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.261027 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.362165 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.362097 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.467486 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.467438 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.498052 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.498007 2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 14:02:48.498493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.498186 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:02:48.498493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.498210 2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 14:02:48.568242 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.568215 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.568242 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.568204 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 13:57:47 +0000 UTC" deadline="2028-02-02 06:30:05.846332946 +0000 UTC" Jul 09 14:02:48.568375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.568261 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13744h27m17.278088296s" Jul 09 14:02:48.634253 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.634175 2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:48.668727 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.668690 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.769208 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.769166 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.781578 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:48.781540 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71787de8705105300f2e3e37e86beb98.slice/crio-f6974cf93a11c95363a0fb2b0207a548e6558ff00af33bf495a631b1b97d227f WatchSource:0}: Error finding container f6974cf93a11c95363a0fb2b0207a548e6558ff00af33bf495a631b1b97d227f: Status 404 returned error can't find the container with id f6974cf93a11c95363a0fb2b0207a548e6558ff00af33bf495a631b1b97d227f Jul 09 14:02:48.786488 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:48.786471 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:02:48.870047 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.870012 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:48.887001 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:48.886975 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e41281165752ad9f9482a713a6ad085.slice/crio-52094aa5ad2621eef5c98714fa40b5bbce1a1312bb4f23f15c0b4f4674bc6288 WatchSource:0}: Error finding container 52094aa5ad2621eef5c98714fa40b5bbce1a1312bb4f23f15c0b4f4674bc6288: Status 404 returned error can't find the container with id 52094aa5ad2621eef5c98714fa40b5bbce1a1312bb4f23f15c0b4f4674bc6288 Jul 09 14:02:48.970643 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:48.970590 2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-157.ec2.internal\" not found" Jul 09 14:02:49.031919 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.031892 2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:49.060081 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.060048 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" Jul 09 14:02:49.074451 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.074426 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:02:49.075548 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.075531 2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" Jul 09 14:02:49.087732 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.087712 2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 14:02:49.542121 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.542085 2556 apiserver.go:52] "Watching apiserver" Jul 09 14:02:49.549744 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.549715 2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 14:02:49.550214 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.550146 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-rtgh4","openshift-multus/network-metrics-daemon-vwqg5","openshift-network-operator/iptables-alerter-95gsd","openshift-ovn-kubernetes/ovnkube-node-db4dx","kube-system/global-pull-secret-syncer-rq9hz","kube-system/konnectivity-agent-zv2jl","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal","openshift-multus/multus-additional-cni-plugins-ds25h","openshift-network-diagnostics/network-check-target-7bfr4","kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal","openshift-cluster-node-tuning-operator/tuned-cq2r5","openshift-dns/node-resolver-vwhwx","openshift-image-registry/node-ca-8x95m"] Jul 09 14:02:49.551858 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.551828 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.553191 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.553147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.554527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.554092 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 14:02:49.554527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.554230 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.554527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.554392 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.554527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.554418 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-74bqg\"" Jul 09 14:02:49.554804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.554733 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.555884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.555449 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.555884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.555687 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.555884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.555765 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-txn5h\"" Jul 09 14:02:49.556194 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.556118 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.557941 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.557919 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.558414 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.558392 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.558641 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.558616 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.559657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.559626 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 14:02:49.559935 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.559916 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 14:02:49.561638 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.561344 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.561638 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.561414 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 14:02:49.561638 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.561550 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.563097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.561861 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-plsbj\"" Jul 09 14:02:49.563097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.561915 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 14:02:49.563097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.562031 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-8vjht\"" Jul 09 14:02:49.563097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.562148 2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 14:02:49.563097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.562339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.563097 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.562596 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:02:49.564232 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.564209 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 14:02:49.564324 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.564285 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.565228 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.565171 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-c79z5\"" Jul 09 14:02:49.565228 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.565210 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 14:02:49.565388 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.565295 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 14:02:49.566543 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.566517 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gxjfm\"" Jul 09 14:02:49.567193 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.566870 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 14:02:49.567193 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.567013 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 14:02:49.567368 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.567351 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.568241 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.568222 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.568477 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.568459 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.568548 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.568479 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 14:02:49.569076 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.569057 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:49.569168 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.569135 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:02:49.569291 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.569271 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 14:02:49.569543 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.569522 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kz2hh\"" Jul 09 14:02:49.570536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.570518 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:49.570629 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.570581 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:02:49.573353 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573326 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd20c943-3b87-483f-b184-857d02f8a052-konnectivity-ca\") pod \"konnectivity-agent-zv2jl\" (UID: \"bd20c943-3b87-483f-b184-857d02f8a052\") " pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.573440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573361 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.573440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-registration-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.573440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573410 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12e721da-1a04-4b92-a323-e79dcbf61072-iptables-alerter-script\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.573440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573434 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-os-release\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573461 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573485 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573509 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-cni-bin\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573560 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beac0780-2d58-49c7-acfd-0460b986dedb-ovn-node-metrics-cert\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573601 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-device-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.573643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573633 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-systemd-units\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573662 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2hlb\" (UniqueName: \"kubernetes.io/projected/12e721da-1a04-4b92-a323-e79dcbf61072-kube-api-access-l2hlb\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573688 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573797 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573828 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-hosts-file\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573855 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bs7z\" (UniqueName: \"kubernetes.io/projected/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-kube-api-access-8bs7z\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573893 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-var-lib-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573917 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd20c943-3b87-483f-b184-857d02f8a052-agent-certs\") pod \"konnectivity-agent-zv2jl\" (UID: \"bd20c943-3b87-483f-b184-857d02f8a052\") " pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573941 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-tmp-dir\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.573993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.573978 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-ovnkube-config\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574037 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mpd4\" (UniqueName: \"kubernetes.io/projected/beac0780-2d58-49c7-acfd-0460b986dedb-kube-api-access-8mpd4\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574091 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574129 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-socket-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574154 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-etc-selinux\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574188 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvz6w\" (UniqueName: \"kubernetes.io/projected/630bf10a-d2b7-4e70-84a3-32ab8c537757-kube-api-access-bvz6w\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574219 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12e721da-1a04-4b92-a323-e79dcbf61072-host-slash\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574245 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfce2ae6-b062-48df-be52-85feb542d036-kubelet-config\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574286 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfce2ae6-b062-48df-be52-85feb542d036-dbus\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574342 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-systemd\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574379 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-etc-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574403 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-env-overrides\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574430 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgx96\" (UniqueName: \"kubernetes.io/projected/772dfbee-a87a-4c43-a2f7-9179242798b2-kube-api-access-tgx96\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.574494 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574483 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-ovn\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574519 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-log-socket\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574548 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-system-cni-dir\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574587 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-node-log\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574616 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-slash\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574651 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-run-netns\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574676 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-cni-netd\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574701 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-ovnkube-script-lib\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574747 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-sys-fs\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574770 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-cnibin\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574803 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-kubelet\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574831 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-run-ovn-kubernetes\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.574862 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.575106 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.575104 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.575725 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.575507 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 14:02:49.575788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.575748 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.576760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.576595 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.576760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.576623 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6nwm6\"" Jul 09 14:02:49.576760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.576685 2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 14:02:49.577414 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.577207 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 14:02:49.577414 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.577379 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rl7lj\"" Jul 09 14:02:49.577596 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.577446 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:02:49.598484 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.598461 2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-svd6l" Jul 09 14:02:49.607655 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.607636 2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-svd6l" Jul 09 14:02:49.663300 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.662596 2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 14:02:49.675331 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675298 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-os-release\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.675491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675346 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.675491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-kubelet\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.675491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-run-ovn-kubernetes\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.675491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675431 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.675491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12e721da-1a04-4b92-a323-e79dcbf61072-iptables-alerter-script\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.675491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675488 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-kubelet\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675514 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-conf-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675541 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-daemon-config\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675579 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpcwm\" (UniqueName: \"kubernetes.io/projected/9a62b831-db6f-4485-b886-34e9d62a8b62-kube-api-access-kpcwm\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675606 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-cni-bin\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675642 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.675658 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675670 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a62b831-db6f-4485-b886-34e9d62a8b62-cni-binary-copy\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675695 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-cni-multus\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675545 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-os-release\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.675760 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:50.175713041 +0000 UTC m=+2.992123298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675787 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-multus-certs\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.675804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675807 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-cni-bin\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675820 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-modprobe-d\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675849 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysctl-conf\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675860 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675642 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675874 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-tuned\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675906 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-hosts-file\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675929 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-kubelet\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675931 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-hostroot\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675957 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-run-ovn-kubernetes\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-kubernetes\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.675982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-lib-modules\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676001 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-tmp-dir\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676017 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-systemd\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676042 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-ovnkube-config\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-socket-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676075 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-hosts-file\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.676597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676114 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12e721da-1a04-4b92-a323-e79dcbf61072-host-slash\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676130 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-system-cni-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-cni-bin\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-etc-kubernetes\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pxbgz\" (UniqueName: \"kubernetes.io/projected/0bddc72f-ace1-451a-aeb5-bee9c4f43939-kube-api-access-pxbgz\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676196 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-env-overrides\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676212 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysctl-d\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676226 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-run\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-system-cni-dir\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676249 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/12e721da-1a04-4b92-a323-e79dcbf61072-iptables-alerter-script\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-cnibin\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676322 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676359 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bs7z\" (UniqueName: \"kubernetes.io/projected/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-kube-api-access-8bs7z\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676401 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-node-log\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676586 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-tmp-dir\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676680 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-env-overrides\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676705 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-socket-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.677470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676753 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12e721da-1a04-4b92-a323-e79dcbf61072-host-slash\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676783 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-system-cni-dir\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676864 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-node-log\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676864 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-ovnkube-config\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676926 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-cni-netd\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676980 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bbp5\" (UniqueName: \"kubernetes.io/projected/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-kube-api-access-9bbp5\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.676985 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-cni-netd\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677047 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd20c943-3b87-483f-b184-857d02f8a052-konnectivity-ca\") pod \"konnectivity-agent-zv2jl\" (UID: \"bd20c943-3b87-483f-b184-857d02f8a052\") " pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677103 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-registration-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677129 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677160 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beac0780-2d58-49c7-acfd-0460b986dedb-ovn-node-metrics-cert\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-device-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677211 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-registration-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677214 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-sys\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677256 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-host\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677274 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d515e7d4-398c-47b2-963d-c7a9f8f83498-host\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d515e7d4-398c-47b2-963d-c7a9f8f83498-serviceca\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.678365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677323 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-systemd-units\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677351 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2hlb\" (UniqueName: \"kubernetes.io/projected/12e721da-1a04-4b92-a323-e79dcbf61072-kube-api-access-l2hlb\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677382 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677376 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-device-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677436 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677455 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-systemd-units\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677503 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677539 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-cni-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677569 2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677571 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-socket-dir-parent\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677624 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysconfig\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677660 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd20c943-3b87-483f-b184-857d02f8a052-konnectivity-ca\") pod \"konnectivity-agent-zv2jl\" (UID: \"bd20c943-3b87-483f-b184-857d02f8a052\") " pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-var-lib-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677696 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-var-lib-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677709 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd20c943-3b87-483f-b184-857d02f8a052-agent-certs\") pod \"konnectivity-agent-zv2jl\" (UID: \"bd20c943-3b87-483f-b184-857d02f8a052\") " pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677735 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-netns\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677764 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mpd4\" (UniqueName: \"kubernetes.io/projected/beac0780-2d58-49c7-acfd-0460b986dedb-kube-api-access-8mpd4\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.679304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677815 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-etc-selinux\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvz6w\" (UniqueName: \"kubernetes.io/projected/630bf10a-d2b7-4e70-84a3-32ab8c537757-kube-api-access-bvz6w\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677869 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677896 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfce2ae6-b062-48df-be52-85feb542d036-kubelet-config\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677922 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfce2ae6-b062-48df-be52-85feb542d036-dbus\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-systemd\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677964 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-cni-binary-copy\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.677971 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-etc-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678012 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-etc-openvswitch\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgx96\" (UniqueName: \"kubernetes.io/projected/772dfbee-a87a-4c43-a2f7-9179242798b2-kube-api-access-tgx96\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678055 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-os-release\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678084 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678072 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678098 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-var-lib-kubelet\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cfce2ae6-b062-48df-be52-85feb542d036-kubelet-config\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678204 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-etc-selinux\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.681568 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cfce2ae6-b062-48df-be52-85feb542d036-dbus\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678275 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-ovn\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678284 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-systemd\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678311 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-log-socket\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678324 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-run-ovn\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678335 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-k8s-cni-cncf-io\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678359 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bddc72f-ace1-451a-aeb5-bee9c4f43939-tmp\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t97jn\" (UniqueName: \"kubernetes.io/projected/d515e7d4-398c-47b2-963d-c7a9f8f83498-kube-api-access-t97jn\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-log-socket\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678404 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678435 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-slash\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678494 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-slash\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678480 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-run-netns\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678533 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-ovnkube-script-lib\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678559 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-sys-fs\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-cnibin\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678635 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/630bf10a-d2b7-4e70-84a3-32ab8c537757-sys-fs\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.682361 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678580 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/beac0780-2d58-49c7-acfd-0460b986dedb-host-run-netns\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.683493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.678720 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/772dfbee-a87a-4c43-a2f7-9179242798b2-cnibin\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.683493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.679710 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/beac0780-2d58-49c7-acfd-0460b986dedb-ovnkube-script-lib\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.683493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.679749 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/772dfbee-a87a-4c43-a2f7-9179242798b2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.683493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.682175 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/beac0780-2d58-49c7-acfd-0460b986dedb-ovn-node-metrics-cert\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.683493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.682321 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd20c943-3b87-483f-b184-857d02f8a052-agent-certs\") pod \"konnectivity-agent-zv2jl\" (UID: \"bd20c943-3b87-483f-b184-857d02f8a052\") " pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.686587 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.686531 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bs7z\" (UniqueName: \"kubernetes.io/projected/6afc7b62-c78d-468c-b8d3-e388a2e7c72d-kube-api-access-8bs7z\") pod \"node-resolver-vwhwx\" (UID: \"6afc7b62-c78d-468c-b8d3-e388a2e7c72d\") " pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.687171 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.687131 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mpd4\" (UniqueName: \"kubernetes.io/projected/beac0780-2d58-49c7-acfd-0460b986dedb-kube-api-access-8mpd4\") pod \"ovnkube-node-db4dx\" (UID: \"beac0780-2d58-49c7-acfd-0460b986dedb\") " pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.687682 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.687660 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2hlb\" (UniqueName: \"kubernetes.io/projected/12e721da-1a04-4b92-a323-e79dcbf61072-kube-api-access-l2hlb\") pod \"iptables-alerter-95gsd\" (UID: \"12e721da-1a04-4b92-a323-e79dcbf61072\") " pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.689067 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.689039 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgx96\" (UniqueName: \"kubernetes.io/projected/772dfbee-a87a-4c43-a2f7-9179242798b2-kube-api-access-tgx96\") pod \"multus-additional-cni-plugins-ds25h\" (UID: \"772dfbee-a87a-4c43-a2f7-9179242798b2\") " pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.689704 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.689680 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvz6w\" (UniqueName: \"kubernetes.io/projected/630bf10a-d2b7-4e70-84a3-32ab8c537757-kube-api-access-bvz6w\") pod \"aws-ebs-csi-driver-node-8h26g\" (UID: \"630bf10a-d2b7-4e70-84a3-32ab8c537757\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.754511 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.754443 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" event={"ID":"7e41281165752ad9f9482a713a6ad085","Type":"ContainerStarted","Data":"52094aa5ad2621eef5c98714fa40b5bbce1a1312bb4f23f15c0b4f4674bc6288"} Jul 09 14:02:49.755746 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.755715 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" event={"ID":"71787de8705105300f2e3e37e86beb98","Type":"ContainerStarted","Data":"f6974cf93a11c95363a0fb2b0207a548e6558ff00af33bf495a631b1b97d227f"} Jul 09 14:02:49.779061 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779003 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-system-cni-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779061 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779059 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-cni-bin\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779095 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-etc-kubernetes\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779112 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-system-cni-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779121 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pxbgz\" (UniqueName: \"kubernetes.io/projected/0bddc72f-ace1-451a-aeb5-bee9c4f43939-kube-api-access-pxbgz\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779159 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysctl-d\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-run\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779217 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-cnibin\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779232 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-cni-bin\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779255 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:49.779292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779289 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bbp5\" (UniqueName: \"kubernetes.io/projected/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-kube-api-access-9bbp5\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779312 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-run\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-sys\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779341 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-host\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779363 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d515e7d4-398c-47b2-963d-c7a9f8f83498-host\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779389 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d515e7d4-398c-47b2-963d-c7a9f8f83498-serviceca\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-etc-kubernetes\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779419 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-cni-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779424 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysctl-d\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779444 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-socket-dir-parent\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779462 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d515e7d4-398c-47b2-963d-c7a9f8f83498-host\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysconfig\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779493 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-host\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-netns\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779514 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-cnibin\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779530 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779569 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-os-release\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779593 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-var-lib-kubelet\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.779788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779620 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-k8s-cni-cncf-io\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779472 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-sys\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779644 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bddc72f-ace1-451a-aeb5-bee9c4f43939-tmp\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779671 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t97jn\" (UniqueName: \"kubernetes.io/projected/d515e7d4-398c-47b2-963d-c7a9f8f83498-kube-api-access-t97jn\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779705 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-os-release\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779758 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-k8s-cni-cncf-io\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.779759 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-netns\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.779804 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.779881 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:02:50.279859659 +0000 UTC m=+3.096269917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780005 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-socket-dir-parent\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780052 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-cni-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780066 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysconfig\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780124 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-kubelet\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780142 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-var-lib-kubelet\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780153 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-conf-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780169 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d515e7d4-398c-47b2-963d-c7a9f8f83498-serviceca\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780184 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-kubelet\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780194 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-daemon-config\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.780760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpcwm\" (UniqueName: \"kubernetes.io/projected/9a62b831-db6f-4485-b886-34e9d62a8b62-kube-api-access-kpcwm\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780227 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-conf-dir\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780247 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a62b831-db6f-4485-b886-34e9d62a8b62-cni-binary-copy\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780273 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-cni-multus\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780300 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-multus-certs\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780329 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-modprobe-d\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780358 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysctl-conf\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780382 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-tuned\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780406 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-hostroot\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-kubernetes\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780459 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-lib-modules\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-systemd\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780541 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-modprobe-d\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780587 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-systemd\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780737 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-sysctl-conf\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780820 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/9a62b831-db6f-4485-b886-34e9d62a8b62-multus-daemon-config\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780874 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-var-lib-cni-multus\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780930 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-kubernetes\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.781709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.780974 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-hostroot\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.782601 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.781018 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9a62b831-db6f-4485-b886-34e9d62a8b62-cni-binary-copy\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.782601 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.781049 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/9a62b831-db6f-4485-b886-34e9d62a8b62-host-run-multus-certs\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.782601 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.781180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0bddc72f-ace1-451a-aeb5-bee9c4f43939-lib-modules\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.782601 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.782581 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0bddc72f-ace1-451a-aeb5-bee9c4f43939-tmp\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.783119 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.783096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0bddc72f-ace1-451a-aeb5-bee9c4f43939-etc-tuned\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.786084 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.786059 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:49.786205 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.786089 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:49.786205 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.786105 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:49.786205 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:49.786167 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:02:50.286149555 +0000 UTC m=+3.102559813 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:49.788961 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.788936 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pxbgz\" (UniqueName: \"kubernetes.io/projected/0bddc72f-ace1-451a-aeb5-bee9c4f43939-kube-api-access-pxbgz\") pod \"tuned-cq2r5\" (UID: \"0bddc72f-ace1-451a-aeb5-bee9c4f43939\") " pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.789974 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.789914 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bbp5\" (UniqueName: \"kubernetes.io/projected/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-kube-api-access-9bbp5\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:49.790539 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.790517 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpcwm\" (UniqueName: \"kubernetes.io/projected/9a62b831-db6f-4485-b886-34e9d62a8b62-kube-api-access-kpcwm\") pod \"multus-rtgh4\" (UID: \"9a62b831-db6f-4485-b886-34e9d62a8b62\") " pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.790978 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.790955 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t97jn\" (UniqueName: \"kubernetes.io/projected/d515e7d4-398c-47b2-963d-c7a9f8f83498-kube-api-access-t97jn\") pod \"node-ca-8x95m\" (UID: \"d515e7d4-398c-47b2-963d-c7a9f8f83498\") " pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.867380 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.867290 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" Jul 09 14:02:49.877522 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.877499 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-vwhwx" Jul 09 14:02:49.886324 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.886299 2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:49.889168 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.889152 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-95gsd" Jul 09 14:02:49.895985 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.895956 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:02:49.904984 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.904961 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:02:49.913840 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.913819 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ds25h" Jul 09 14:02:49.922831 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.922813 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rtgh4" Jul 09 14:02:49.930697 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.930676 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8x95m" Jul 09 14:02:49.936274 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.936257 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" Jul 09 14:02:49.984895 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:49.984863 2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 14:02:50.184476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.184377 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:50.184627 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.184589 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:50.184699 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.184683 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:51.184663466 +0000 UTC m=+4.001073732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:50.285614 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.285573 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:50.285814 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.285757 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:50.285884 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.285843 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:02:51.285821479 +0000 UTC m=+4.102231746 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:50.386663 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.386623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:50.386828 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.386778 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:50.386828 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.386800 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:50.386828 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.386810 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:50.386929 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.386864 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:02:51.386851095 +0000 UTC m=+4.203261345 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:50.569667 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:50.569547 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12e721da_1a04_4b92_a323_e79dcbf61072.slice/crio-c29e70e9e9b4ac19c6577e050542fecba2f2c0c4d275d6566bc92992639f991c WatchSource:0}: Error finding container c29e70e9e9b4ac19c6577e050542fecba2f2c0c4d275d6566bc92992639f991c: Status 404 returned error can't find the container with id c29e70e9e9b4ac19c6577e050542fecba2f2c0c4d275d6566bc92992639f991c Jul 09 14:02:50.575710 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:50.575681 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeac0780_2d58_49c7_acfd_0460b986dedb.slice/crio-02de3734231ab9d8a46750e3acb6f652b3e45f27c9bcafb72d1b149a9c8fe610 WatchSource:0}: Error finding container 02de3734231ab9d8a46750e3acb6f652b3e45f27c9bcafb72d1b149a9c8fe610: Status 404 returned error can't find the container with id 02de3734231ab9d8a46750e3acb6f652b3e45f27c9bcafb72d1b149a9c8fe610 Jul 09 14:02:50.576214 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:50.576181 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod772dfbee_a87a_4c43_a2f7_9179242798b2.slice/crio-205ab28102a360a060b6fa451dca4ebe1b20a9610064552a637229eadf1e5f1d WatchSource:0}: Error finding container 205ab28102a360a060b6fa451dca4ebe1b20a9610064552a637229eadf1e5f1d: Status 404 returned error can't find the container with id 205ab28102a360a060b6fa451dca4ebe1b20a9610064552a637229eadf1e5f1d Jul 09 14:02:50.576871 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:50.576852 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a62b831_db6f_4485_b886_34e9d62a8b62.slice/crio-2ca5233cfc8f38f25a4dd5b6cc76bec73d1ff9fea4da37948c08119b9e455cb7 WatchSource:0}: Error finding container 2ca5233cfc8f38f25a4dd5b6cc76bec73d1ff9fea4da37948c08119b9e455cb7: Status 404 returned error can't find the container with id 2ca5233cfc8f38f25a4dd5b6cc76bec73d1ff9fea4da37948c08119b9e455cb7 Jul 09 14:02:50.578065 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:02:50.578036 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6afc7b62_c78d_468c_b8d3_e388a2e7c72d.slice/crio-93939ac5d9898bce28da19a25998e157bd355469b776e0086df2e49341494437 WatchSource:0}: Error finding container 93939ac5d9898bce28da19a25998e157bd355469b776e0086df2e49341494437: Status 404 returned error can't find the container with id 93939ac5d9898bce28da19a25998e157bd355469b776e0086df2e49341494437 Jul 09 14:02:50.609783 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.609740 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:57:49 +0000 UTC" deadline="2028-03-13 12:26:55.303882593 +0000 UTC" Jul 09 14:02:50.609783 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.609781 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14710h24m4.694103848s" Jul 09 14:02:50.750348 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.750320 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:50.750492 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:50.750426 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:02:50.759435 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.759404 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" event={"ID":"630bf10a-d2b7-4e70-84a3-32ab8c537757","Type":"ContainerStarted","Data":"7748a2c5c0b8cf592d2f20cf23b0327bae7cd51409b7d2886f7bd28544ec5a5e"} Jul 09 14:02:50.760501 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.760470 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv2jl" event={"ID":"bd20c943-3b87-483f-b184-857d02f8a052","Type":"ContainerStarted","Data":"55d9bf324b5acfeae7ca84828bca10f811c9e9321a1fad3b7d3f5b417338c701"} Jul 09 14:02:50.761580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.761552 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vwhwx" event={"ID":"6afc7b62-c78d-468c-b8d3-e388a2e7c72d","Type":"ContainerStarted","Data":"93939ac5d9898bce28da19a25998e157bd355469b776e0086df2e49341494437"} Jul 09 14:02:50.762610 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.762587 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-95gsd" event={"ID":"12e721da-1a04-4b92-a323-e79dcbf61072","Type":"ContainerStarted","Data":"c29e70e9e9b4ac19c6577e050542fecba2f2c0c4d275d6566bc92992639f991c"} Jul 09 14:02:50.764371 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.764347 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" event={"ID":"7e41281165752ad9f9482a713a6ad085","Type":"ContainerStarted","Data":"4b65d3f5d4e24742d9a78888cb1698772dcb70bbd2f4d73077162d5b3911c210"} Jul 09 14:02:50.765523 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.765502 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" event={"ID":"0bddc72f-ace1-451a-aeb5-bee9c4f43939","Type":"ContainerStarted","Data":"0e6af07eaf0bca52ddbdc23c1806a12c3b26e893da64eeb9b0903d39b6ffdf33"} Jul 09 14:02:50.766570 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.766550 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8x95m" event={"ID":"d515e7d4-398c-47b2-963d-c7a9f8f83498","Type":"ContainerStarted","Data":"557e6cdf63e16d9a66c29914513de92ad0dcb19b61fd204158657a6b8669085a"} Jul 09 14:02:50.767587 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.767562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rtgh4" event={"ID":"9a62b831-db6f-4485-b886-34e9d62a8b62","Type":"ContainerStarted","Data":"2ca5233cfc8f38f25a4dd5b6cc76bec73d1ff9fea4da37948c08119b9e455cb7"} Jul 09 14:02:50.768624 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.768591 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerStarted","Data":"205ab28102a360a060b6fa451dca4ebe1b20a9610064552a637229eadf1e5f1d"} Jul 09 14:02:50.769735 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.769716 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"02de3734231ab9d8a46750e3acb6f652b3e45f27c9bcafb72d1b149a9c8fe610"} Jul 09 14:02:50.781981 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:50.781934 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-157.ec2.internal" podStartSLOduration=1.7819225730000001 podStartE2EDuration="1.781922573s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:02:50.781758293 +0000 UTC m=+3.598168567" watchObservedRunningTime="2026-07-09 14:02:50.781922573 +0000 UTC m=+3.598332843" Jul 09 14:02:51.193176 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.193137 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:51.193383 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.193309 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:51.193383 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.193382 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:53.193357182 +0000 UTC m=+6.009767446 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:51.294050 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.293958 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:51.294417 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.294231 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:51.294417 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.294304 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:02:53.294282772 +0000 UTC m=+6.110693040 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:51.395387 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.395347 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:51.395587 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.395534 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:51.395587 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.395555 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:51.395587 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.395569 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:51.395770 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.395628 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:02:53.395609945 +0000 UTC m=+6.212020214 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:51.610232 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.610184 2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 13:57:49 +0000 UTC" deadline="2028-03-30 05:22:58.956999866 +0000 UTC" Jul 09 14:02:51.610232 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.610229 2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15111h20m7.34677568s" Jul 09 14:02:51.752701 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.752661 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:51.752896 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.752800 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:02:51.753296 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:51.753271 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:51.753472 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:51.753414 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:02:52.750427 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:52.750318 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:52.750896 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:52.750448 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:02:53.213886 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:53.213637 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:53.214079 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.214051 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:53.214147 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.214120 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:02:57.214100255 +0000 UTC m=+10.030510505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:53.314874 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:53.314838 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:53.315080 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.315031 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:53.315142 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.315099 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:02:57.31507866 +0000 UTC m=+10.131488910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:53.415874 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:53.415833 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:53.416078 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.416036 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:53.416078 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.416056 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:53.416078 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.416068 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:53.416247 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.416125 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:02:57.416107625 +0000 UTC m=+10.232517888 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:53.753256 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:53.752570 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:53.753256 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.752688 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:02:53.753256 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:53.752770 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:53.753256 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:53.752865 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:02:54.750103 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:54.750068 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:54.750291 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:54.750205 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:02:55.749650 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:55.749617 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:55.749650 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:55.749645 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:55.750125 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:55.749856 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:02:55.750125 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:55.749976 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:02:56.750146 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:56.750046 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:56.750635 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:56.750186 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:02:57.246936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:57.246894 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:57.247122 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.247070 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:57.247184 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.247143 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:05.247122554 +0000 UTC m=+18.063532813 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:02:57.347466 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:57.347428 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:57.347653 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.347615 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:57.347721 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.347677 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:03:05.347658136 +0000 UTC m=+18.164068400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:02:57.448766 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:57.448733 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:57.448946 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.448873 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:02:57.448946 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.448893 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:02:57.448946 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.448904 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:57.449124 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.448967 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:05.448950404 +0000 UTC m=+18.265360660 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:02:57.750671 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:57.750585 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:57.750671 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:57.750664 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:57.751202 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.750757 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:02:57.751202 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:57.750891 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:02:58.749404 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:58.749363 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:02:58.749608 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:58.749500 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:02:59.750160 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:59.749597 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:02:59.750160 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:59.749734 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:02:59.750160 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:02:59.749967 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:02:59.750160 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:02:59.750089 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:00.750510 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:00.750423 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:00.750952 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:00.750577 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:01.751603 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:01.751573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:01.751968 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:01.751573 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:01.751968 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:01.751715 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:01.751968 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:01.751806 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:02.749674 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.749607 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:02.749804 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:02.749726 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:02.810085 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.809816 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" event={"ID":"630bf10a-d2b7-4e70-84a3-32ab8c537757","Type":"ContainerStarted","Data":"762c1f1daf294df2a2e340f535f07874d4058846df0d35cd08563fd37f8eaaa6"} Jul 09 14:03:02.812093 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.811665 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-zv2jl" event={"ID":"bd20c943-3b87-483f-b184-857d02f8a052","Type":"ContainerStarted","Data":"3269fb3061ad46ce6bcfb941e56d608188b1ea8663c147682fad1fda2ecb4210"} Jul 09 14:03:02.813737 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.813706 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-vwhwx" event={"ID":"6afc7b62-c78d-468c-b8d3-e388a2e7c72d","Type":"ContainerStarted","Data":"dd522b3cd2fa5e6360db136e04b9f0f243af8b1805521ae7d359768ee1eca85f"} Jul 09 14:03:02.815780 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.815758 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" event={"ID":"71787de8705105300f2e3e37e86beb98","Type":"ContainerStarted","Data":"b029a34f72a187a84ed14442117aad72572545e0f815e46b74b837af33d30476"} Jul 09 14:03:02.817441 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.817413 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" event={"ID":"0bddc72f-ace1-451a-aeb5-bee9c4f43939","Type":"ContainerStarted","Data":"b700a4da99193778e7785062acd4ae5d7f1e5efd0556ff8834df7e2b72adeb74"} Jul 09 14:03:02.819806 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.819767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8x95m" event={"ID":"d515e7d4-398c-47b2-963d-c7a9f8f83498","Type":"ContainerStarted","Data":"e3ba0b166a0b48d84aff4e7ced97ef96a6e3b6c3ca71c970c1489dce15743e9d"} Jul 09 14:03:02.823869 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.823847 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerStarted","Data":"fee599af76a62c026bd458f734ba910e50b5bd1b5707eefc71af8e25ce4dd4e8"} Jul 09 14:03:02.827268 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.827232 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-zv2jl" podStartSLOduration=3.913631048 podStartE2EDuration="14.82722002s" totalImagesPullingTime="10.913588972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:02.826571413 +0000 UTC m=+15.642981676" watchObservedRunningTime="2026-07-09 14:03:02.82722002 +0000 UTC m=+15.643630291" Jul 09 14:03:02.878613 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.878554 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8x95m" podStartSLOduration=3.926875515 podStartE2EDuration="14.87853285s" totalImagesPullingTime="10.951657335s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:02.862802403 +0000 UTC m=+15.679212676" watchObservedRunningTime="2026-07-09 14:03:02.87853285 +0000 UTC m=+15.694943122" Jul 09 14:03:02.893029 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.892950 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-cq2r5" podStartSLOduration=3.54058604 podStartE2EDuration="14.892931061s" totalImagesPullingTime="11.352345021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:02.878458421 +0000 UTC m=+15.694868694" watchObservedRunningTime="2026-07-09 14:03:02.892931061 +0000 UTC m=+15.709341334" Jul 09 14:03:02.907645 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:02.907597 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-vwhwx" podStartSLOduration=3.992884062 podStartE2EDuration="14.90758554s" totalImagesPullingTime="10.914701478s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:02.893961164 +0000 UTC m=+15.710371436" watchObservedRunningTime="2026-07-09 14:03:02.90758554 +0000 UTC m=+15.723995811" Jul 09 14:03:03.750340 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:03.750117 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:03.750340 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:03.750117 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:03.750340 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:03.750268 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:03.750340 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:03.750322 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:03.827478 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:03.827436 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-95gsd" event={"ID":"12e721da-1a04-4b92-a323-e79dcbf61072","Type":"ContainerStarted","Data":"afde70ed1054757e69d221b30d5bcfbf0784cfc45da0578d45d4d69860294a98"} Jul 09 14:03:04.749590 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:04.749554 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:04.749813 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:04.749665 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:05.309539 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:05.309500 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:05.310087 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.309671 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:05.310087 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.309761 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:21.309738872 +0000 UTC m=+34.126149125 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:05.410730 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:05.410699 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:05.410904 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.410837 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:05.410904 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.410901 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:03:21.410881485 +0000 UTC m=+34.227291756 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:05.511582 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:05.511545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:05.511756 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.511679 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:03:05.511756 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.511694 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:03:05.511756 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.511706 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:05.511873 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.511768 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:21.511749455 +0000 UTC m=+34.328159704 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:05.750132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:05.750095 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:05.750132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:05.750135 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:05.750378 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.750222 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:05.750378 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:05.750306 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:06.749851 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:06.749815 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:06.750362 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:06.749933 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:06.836430 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:06.836393 2556 generic.go:356] "Generic (PLEG): container finished" podID="772dfbee-a87a-4c43-a2f7-9179242798b2" containerID="fee599af76a62c026bd458f734ba910e50b5bd1b5707eefc71af8e25ce4dd4e8" exitCode=0 Jul 09 14:03:06.836591 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:06.836437 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerDied","Data":"fee599af76a62c026bd458f734ba910e50b5bd1b5707eefc71af8e25ce4dd4e8"} Jul 09 14:03:06.864254 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:06.864198 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-95gsd" podStartSLOduration=7.938389217 podStartE2EDuration="18.864178722s" totalImagesPullingTime="10.925789505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:03.842491299 +0000 UTC m=+16.658901569" watchObservedRunningTime="2026-07-09 14:03:06.864178722 +0000 UTC m=+19.680588992" Jul 09 14:03:07.163547 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:07.163470 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:03:07.164075 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:07.164054 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:03:07.750936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:07.750898 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:07.751505 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:07.751026 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:07.751505 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:07.751064 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:07.751505 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:07.751178 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:07.839172 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:07.839128 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:03:07.842669 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:07.842643 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-zv2jl" Jul 09 14:03:08.750080 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:08.750044 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:08.750251 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:08.750175 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:09.750065 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:09.750019 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:09.750531 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:09.750032 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:09.750531 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:09.750155 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:09.750531 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:09.750247 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:10.635152 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.634867 2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 14:03:10.637877 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.637789 2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:03:10.635150537Z","UUID":"7c9e2022-a7bc-482f-ad70-6f999ad060ca","Handler":null,"Name":"","Endpoint":""} Jul 09 14:03:10.641032 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.640993 2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 14:03:10.641124 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.641052 2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 14:03:10.749480 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.749451 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:10.749622 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:10.749578 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:10.849247 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.849192 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:03:10.849827 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.849797 2556 generic.go:356] "Generic (PLEG): container finished" podID="beac0780-2d58-49c7-acfd-0460b986dedb" containerID="f4559adc41d6d660abad3aeff12766291d31281c67a233048031a753f6a4c770" exitCode=1 Jul 09 14:03:10.849951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.849889 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"43e5625ed6433632c5da288fe5b353cc051165452c8c283acd3afc0a1c2534f3"} Jul 09 14:03:10.850054 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.849968 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerDied","Data":"f4559adc41d6d660abad3aeff12766291d31281c67a233048031a753f6a4c770"} Jul 09 14:03:10.850054 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.850042 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"c577bedbfad8a97504332522cfa80962e5b7c1995b56ddd336e55243b4b94f67"} Jul 09 14:03:10.852090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.852062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" event={"ID":"630bf10a-d2b7-4e70-84a3-32ab8c537757","Type":"ContainerStarted","Data":"fb896a10a2f87c1facc7675207b43b932a1c799c4e6ab4a0a13f61c8cc5e91ca"} Jul 09 14:03:10.854215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.854193 2556 generic.go:356] "Generic (PLEG): container finished" podID="71787de8705105300f2e3e37e86beb98" containerID="b029a34f72a187a84ed14442117aad72572545e0f815e46b74b837af33d30476" exitCode=0 Jul 09 14:03:10.854324 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.854269 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" event={"ID":"71787de8705105300f2e3e37e86beb98","Type":"ContainerDied","Data":"b029a34f72a187a84ed14442117aad72572545e0f815e46b74b837af33d30476"} Jul 09 14:03:10.855999 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:10.855973 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rtgh4" event={"ID":"9a62b831-db6f-4485-b886-34e9d62a8b62","Type":"ContainerStarted","Data":"96503657018b88853ff5499e23f8305079f10a383a46f3dec566e015ec4619ce"} Jul 09 14:03:11.750117 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.749916 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:11.750345 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.749991 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:11.750345 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:11.750211 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:11.750477 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:11.750340 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:11.860438 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.860400 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" event={"ID":"71787de8705105300f2e3e37e86beb98","Type":"ContainerStarted","Data":"4065761ae39a13660d3e5d211d618ce8e6e15c91525a3d82d1edefa04119c020"} Jul 09 14:03:11.863364 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.863340 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:03:11.863851 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.863823 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"301c636e813ce8a2d8ae822d7389eadaaa36deb7adf9591ac1f9a27cc5f75a3f"} Jul 09 14:03:11.863959 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.863903 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"672157092f14379f9ba4bb36882e194bd2ef2ab270f6168bd1dff55393957620"} Jul 09 14:03:11.863959 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.863942 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"4c7b7c349e57e62382e7e02263aee3eca6dfdadf5165c415cbd927f4ca2abf3b"} Jul 09 14:03:11.875709 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.875668 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rtgh4" podStartSLOduration=3.986452882 podStartE2EDuration="23.875655077s" totalImagesPullingTime="19.889202195s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:10.886487998 +0000 UTC m=+23.702898270" watchObservedRunningTime="2026-07-09 14:03:11.875655077 +0000 UTC m=+24.692065351" Jul 09 14:03:11.876097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:11.876075 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-157.ec2.internal" podStartSLOduration=22.876066334 podStartE2EDuration="22.876066334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:11.875712117 +0000 UTC m=+24.692122388" watchObservedRunningTime="2026-07-09 14:03:11.876066334 +0000 UTC m=+24.692476604" Jul 09 14:03:12.750321 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:12.750287 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:12.750565 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:12.750402 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:12.869657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:12.869612 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" event={"ID":"630bf10a-d2b7-4e70-84a3-32ab8c537757","Type":"ContainerStarted","Data":"b0e92605a9653c66fc54bcd25e790b603186391668fc15fa846041bd47a16e44"} Jul 09 14:03:12.887610 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:12.887565 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8h26g" podStartSLOduration=4.7199936860000005 podStartE2EDuration="24.887546149s" totalImagesPullingTime="20.167552463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:12.887163589 +0000 UTC m=+25.703573861" watchObservedRunningTime="2026-07-09 14:03:12.887546149 +0000 UTC m=+25.703956419" Jul 09 14:03:13.750282 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:13.750247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:13.750471 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:13.750247 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:13.750471 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:13.750398 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:13.750576 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:13.750476 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:13.874797 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:13.874770 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:03:13.875326 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:13.875289 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"8fdf474c3e102cac34e4944c0a6adbd0a41e4a1b615dfc8284915f717b2e412e"} Jul 09 14:03:14.750112 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:14.750076 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:14.750297 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:14.750208 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:15.750350 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.750160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:15.751001 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.750181 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:15.751001 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:15.750459 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:15.751001 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:15.750547 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:15.880926 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.880897 2556 generic.go:356] "Generic (PLEG): container finished" podID="772dfbee-a87a-4c43-a2f7-9179242798b2" containerID="59a01862d2af0b011d144f0f55730b0964f6f14118fce176208e1b6d9d6cd013" exitCode=0 Jul 09 14:03:15.881100 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.880968 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerDied","Data":"59a01862d2af0b011d144f0f55730b0964f6f14118fce176208e1b6d9d6cd013"} Jul 09 14:03:15.884838 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.884821 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:03:15.885191 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.885173 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"e9369cf8abe6e0f7ed3fdc2d463705f4f241d67added4c66991a2aeb29a7ef0b"} Jul 09 14:03:15.885423 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.885404 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:03:15.885553 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.885480 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:03:15.885604 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.885550 2556 scope.go:117] "RemoveContainer" containerID="f4559adc41d6d660abad3aeff12766291d31281c67a233048031a753f6a4c770" Jul 09 14:03:15.903202 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:15.903170 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:03:16.749809 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:16.749776 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:16.750078 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:16.749893 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:16.890621 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:16.890595 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:03:16.891137 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:16.890935 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" event={"ID":"beac0780-2d58-49c7-acfd-0460b986dedb","Type":"ContainerStarted","Data":"ee6feb75b20958fb49db97ddaebdb6266acec45c90402ba51c2b3e1e11a8b9d2"} Jul 09 14:03:16.891137 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:16.891131 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:03:16.906887 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:16.906862 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:03:16.920394 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:16.920331 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" podStartSLOduration=9.03104874 podStartE2EDuration="28.92031341s" totalImagesPullingTime="19.88926467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:16.919355909 +0000 UTC m=+29.735766181" watchObservedRunningTime="2026-07-09 14:03:16.92031341 +0000 UTC m=+29.736723683" Jul 09 14:03:17.278604 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.278526 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vwqg5"] Jul 09 14:03:17.278736 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.278707 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:17.278817 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:17.278796 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:17.281231 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.281150 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq9hz"] Jul 09 14:03:17.281572 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.281538 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:17.281707 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:17.281658 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:17.281768 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.281705 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bfr4"] Jul 09 14:03:17.281808 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.281787 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:17.281879 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:17.281861 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:17.895515 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.895343 2556 generic.go:356] "Generic (PLEG): container finished" podID="772dfbee-a87a-4c43-a2f7-9179242798b2" containerID="caeda75e134b9e8f684a87196726d593cfa4b3bddef53aec02f106229e4f0370" exitCode=0 Jul 09 14:03:17.895856 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:17.895423 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerDied","Data":"caeda75e134b9e8f684a87196726d593cfa4b3bddef53aec02f106229e4f0370"} Jul 09 14:03:18.750150 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:18.750120 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:18.750315 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:18.750160 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:18.750315 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:18.750215 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:18.750315 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:18.750240 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:18.750530 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:18.750382 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:18.750530 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:18.750484 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:19.903073 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:19.903040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerDied","Data":"1e3cf4c38972ee799f8eb1b42dbb205c7ecb2517c1d4ddef4e611467cd09f3d9"} Jul 09 14:03:19.903687 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:19.903037 2556 generic.go:356] "Generic (PLEG): container finished" podID="772dfbee-a87a-4c43-a2f7-9179242798b2" containerID="1e3cf4c38972ee799f8eb1b42dbb205c7ecb2517c1d4ddef4e611467cd09f3d9" exitCode=0 Jul 09 14:03:20.749636 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:20.749602 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:20.749809 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:20.749602 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:20.749809 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:20.749707 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:20.749809 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:20.749602 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:20.749910 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:20.749771 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:20.749910 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:20.749863 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:21.329867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:21.329832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:21.330349 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.329946 2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:21.330349 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.329998 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret podName:cfce2ae6-b062-48df-be52-85feb542d036 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:53.329984859 +0000 UTC m=+66.146395107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret") pod "global-pull-secret-syncer-rq9hz" (UID: "cfce2ae6-b062-48df-be52-85feb542d036") : object "kube-system"/"original-pull-secret" not registered Jul 09 14:03:21.431022 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:21.430978 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:21.431253 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.431230 2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:21.431337 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.431312 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs podName:ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be nodeName:}" failed. No retries permitted until 2026-07-09 14:03:53.431289854 +0000 UTC m=+66.247700145 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs") pod "network-metrics-daemon-vwqg5" (UID: "ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 14:03:21.532288 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:21.532262 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:21.532405 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.532379 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 14:03:21.532405 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.532392 2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 14:03:21.532405 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.532400 2556 projected.go:196] Error preparing data for projected volume kube-api-access-prvd9 for pod openshift-network-diagnostics/network-check-target-7bfr4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:21.532495 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:21.532448 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9 podName:bc2c76d4-49d9-40e9-9063-f589cdad35dd nodeName:}" failed. No retries permitted until 2026-07-09 14:03:53.532434736 +0000 UTC m=+66.348844986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-prvd9" (UniqueName: "kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9") pod "network-check-target-7bfr4" (UID: "bc2c76d4-49d9-40e9-9063-f589cdad35dd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 14:03:22.750363 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.750329 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:22.750714 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.750329 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:22.750714 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:22.750438 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vwqg5" podUID="ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be" Jul 09 14:03:22.750714 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:22.750508 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7bfr4" podUID="bc2c76d4-49d9-40e9-9063-f589cdad35dd" Jul 09 14:03:22.750714 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.750329 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:22.750714 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:22.750590 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-rq9hz" podUID="cfce2ae6-b062-48df-be52-85feb542d036" Jul 09 14:03:22.930758 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.930729 2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-157.ec2.internal" event="NodeReady" Jul 09 14:03:22.930931 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.930890 2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 14:03:22.966952 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.966918 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-594c756dc4-8cg4d"] Jul 09 14:03:22.969474 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.969447 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:22.971951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.971928 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zggw5\"" Jul 09 14:03:22.972112 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.971960 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 14:03:22.972112 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.972030 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 14:03:22.972231 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.972207 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 14:03:22.977531 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.977506 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 14:03:22.979742 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.979724 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-4q4vz"] Jul 09 14:03:22.981925 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.981906 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:22.984204 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.984183 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 14:03:22.984305 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.984240 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 14:03:22.984305 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.984183 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 14:03:22.984305 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.984271 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xwx6q\"" Jul 09 14:03:22.985775 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.985751 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-h5zc8"] Jul 09 14:03:22.988107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.988089 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-594c756dc4-8cg4d"] Jul 09 14:03:22.988196 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.988184 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:22.990266 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.990246 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 14:03:22.990625 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.990398 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5w7z\"" Jul 09 14:03:22.990625 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.990621 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 14:03:22.995527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.995476 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4q4vz"] Jul 09 14:03:22.997840 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:22.997776 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h5zc8"] Jul 09 14:03:23.141822 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141726 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c4b761e-1c4d-4710-b559-464a67cfef04-ca-trust-extracted\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.141822 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141771 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-trusted-ca\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.141822 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141804 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bf72a99-1009-4a83-9ab6-9393ac5b4814-config-volume\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141830 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-image-registry-private-configuration\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-certificates\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141925 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf72a99-1009-4a83-9ab6-9393ac5b4814-tmp-dir\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141982 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.141997 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f-cert\") pod \"ingress-canary-4q4vz\" (UID: \"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f\") " pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.142064 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hmk\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-kube-api-access-22hmk\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.142107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.142110 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qvdk\" (UniqueName: \"kubernetes.io/projected/7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f-kube-api-access-4qvdk\") pod \"ingress-canary-4q4vz\" (UID: \"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f\") " pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.142389 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.142146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-bound-sa-token\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.142389 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.142176 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-installation-pull-secrets\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.142389 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.142197 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.142389 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.142221 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2fcc\" (UniqueName: \"kubernetes.io/projected/3bf72a99-1009-4a83-9ab6-9393ac5b4814-kube-api-access-f2fcc\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.243122 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243080 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c4b761e-1c4d-4710-b559-464a67cfef04-ca-trust-extracted\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243122 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243139 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-trusted-ca\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243382 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243162 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bf72a99-1009-4a83-9ab6-9393ac5b4814-config-volume\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.243382 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243185 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-image-registry-private-configuration\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243488 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243440 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-certificates\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243489 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf72a99-1009-4a83-9ab6-9393ac5b4814-tmp-dir\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.243626 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243545 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243626 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243572 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f-cert\") pod \"ingress-canary-4q4vz\" (UID: \"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f\") " pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.243626 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243590 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c4b761e-1c4d-4710-b559-464a67cfef04-ca-trust-extracted\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243626 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243606 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22hmk\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-kube-api-access-22hmk\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243662 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qvdk\" (UniqueName: \"kubernetes.io/projected/7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f-kube-api-access-4qvdk\") pod \"ingress-canary-4q4vz\" (UID: \"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f\") " pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.243784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243711 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-bound-sa-token\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-installation-pull-secrets\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.243784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243769 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.243784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243784 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2fcc\" (UniqueName: \"kubernetes.io/projected/3bf72a99-1009-4a83-9ab6-9393ac5b4814-kube-api-access-f2fcc\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.244035 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243808 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3bf72a99-1009-4a83-9ab6-9393ac5b4814-tmp-dir\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.244035 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.243891 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/3bf72a99-1009-4a83-9ab6-9393ac5b4814-config-volume\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.244035 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.243928 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:03:23.244035 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.243953 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594c756dc4-8cg4d: secret "image-registry-tls" not found Jul 09 14:03:23.244181 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.244042 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls podName:8c4b761e-1c4d-4710-b559-464a67cfef04 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:23.744001984 +0000 UTC m=+36.560412245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls") pod "image-registry-594c756dc4-8cg4d" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04") : secret "image-registry-tls" not found Jul 09 14:03:23.244600 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.244251 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-trusted-ca\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.244600 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.244319 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:23.244600 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.244377 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls podName:3bf72a99-1009-4a83-9ab6-9393ac5b4814 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:23.744362303 +0000 UTC m=+36.560772566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls") pod "dns-default-h5zc8" (UID: "3bf72a99-1009-4a83-9ab6-9393ac5b4814") : secret "dns-default-metrics-tls" not found Jul 09 14:03:23.244600 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.244568 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-certificates\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.248296 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.248156 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-image-registry-private-configuration\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.248413 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.248176 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-installation-pull-secrets\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.248413 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.248193 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f-cert\") pod \"ingress-canary-4q4vz\" (UID: \"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f\") " pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.252149 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.252124 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2fcc\" (UniqueName: \"kubernetes.io/projected/3bf72a99-1009-4a83-9ab6-9393ac5b4814-kube-api-access-f2fcc\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.252631 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.252605 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-bound-sa-token\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.252725 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.252677 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qvdk\" (UniqueName: \"kubernetes.io/projected/7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f-kube-api-access-4qvdk\") pod \"ingress-canary-4q4vz\" (UID: \"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f\") " pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.253662 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.253641 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hmk\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-kube-api-access-22hmk\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.292768 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.292684 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-4q4vz" Jul 09 14:03:23.446029 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.445982 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-4q4vz"] Jul 09 14:03:23.450222 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:23.450197 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3b6086_726b_4e5c_a5a4_9b5fcf9c6f2f.slice/crio-54a5b16cf409f9bf29c6312f3757a53345b94c17cc4da8b1410c1e64259f697f WatchSource:0}: Error finding container 54a5b16cf409f9bf29c6312f3757a53345b94c17cc4da8b1410c1e64259f697f: Status 404 returned error can't find the container with id 54a5b16cf409f9bf29c6312f3757a53345b94c17cc4da8b1410c1e64259f697f Jul 09 14:03:23.747830 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.747791 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:23.748044 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.747868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:23.748044 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.747954 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:03:23.748044 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.747973 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594c756dc4-8cg4d: secret "image-registry-tls" not found Jul 09 14:03:23.748044 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.748022 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:23.748253 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.748062 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls podName:8c4b761e-1c4d-4710-b559-464a67cfef04 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:24.748039772 +0000 UTC m=+37.564450081 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls") pod "image-registry-594c756dc4-8cg4d" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04") : secret "image-registry-tls" not found Jul 09 14:03:23.748253 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:23.748078 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls podName:3bf72a99-1009-4a83-9ab6-9393ac5b4814 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:24.748071508 +0000 UTC m=+37.564481756 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls") pod "dns-default-h5zc8" (UID: "3bf72a99-1009-4a83-9ab6-9393ac5b4814") : secret "dns-default-metrics-tls" not found Jul 09 14:03:23.914110 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:23.914078 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4q4vz" event={"ID":"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f","Type":"ContainerStarted","Data":"54a5b16cf409f9bf29c6312f3757a53345b94c17cc4da8b1410c1e64259f697f"} Jul 09 14:03:24.749531 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.749491 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:24.749531 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.749527 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:24.749763 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.749527 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:24.752412 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.752338 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:03:24.752412 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.752342 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27nh2\"" Jul 09 14:03:24.752412 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.752411 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:03:24.753130 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.753097 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:03:24.753253 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.753159 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:03:24.753253 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.753108 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wp6bz\"" Jul 09 14:03:24.756621 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.756598 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:24.756736 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:24.756678 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:24.756793 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:24.756744 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:24.756844 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:24.756793 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:03:24.756844 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:24.756803 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls podName:3bf72a99-1009-4a83-9ab6-9393ac5b4814 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:26.756783748 +0000 UTC m=+39.573194015 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls") pod "dns-default-h5zc8" (UID: "3bf72a99-1009-4a83-9ab6-9393ac5b4814") : secret "dns-default-metrics-tls" not found Jul 09 14:03:24.756844 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:24.756804 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594c756dc4-8cg4d: secret "image-registry-tls" not found Jul 09 14:03:24.756844 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:24.756836 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls podName:8c4b761e-1c4d-4710-b559-464a67cfef04 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:26.756827175 +0000 UTC m=+39.573237431 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls") pod "image-registry-594c756dc4-8cg4d" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04") : secret "image-registry-tls" not found Jul 09 14:03:26.772907 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:26.772866 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:26.773376 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:26.772946 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:26.773376 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:26.773055 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:03:26.773376 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:26.773069 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594c756dc4-8cg4d: secret "image-registry-tls" not found Jul 09 14:03:26.773376 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:26.773123 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls podName:8c4b761e-1c4d-4710-b559-464a67cfef04 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:30.773107517 +0000 UTC m=+43.589517777 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls") pod "image-registry-594c756dc4-8cg4d" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04") : secret "image-registry-tls" not found Jul 09 14:03:26.773376 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:26.773124 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:26.773376 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:26.773188 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls podName:3bf72a99-1009-4a83-9ab6-9393ac5b4814 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:30.773169487 +0000 UTC m=+43.589579753 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls") pod "dns-default-h5zc8" (UID: "3bf72a99-1009-4a83-9ab6-9393ac5b4814") : secret "dns-default-metrics-tls" not found Jul 09 14:03:27.927628 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:27.927397 2556 generic.go:356] "Generic (PLEG): container finished" podID="772dfbee-a87a-4c43-a2f7-9179242798b2" containerID="69a2692d98a0250e2cbfbff69682b1f1a3022b0fadce4fa93ad5c641413e3fbd" exitCode=0 Jul 09 14:03:27.927628 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:27.927475 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerDied","Data":"69a2692d98a0250e2cbfbff69682b1f1a3022b0fadce4fa93ad5c641413e3fbd"} Jul 09 14:03:27.929149 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:27.929126 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-4q4vz" event={"ID":"7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f","Type":"ContainerStarted","Data":"eaf940f8349d53bd4992217e87ff21dccda591ebd3ccd39ea4a47e7380687332"} Jul 09 14:03:27.963803 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:27.963753 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-4q4vz" podStartSLOduration=1.762814354 podStartE2EDuration="5.963735472s" totalImagesPullingTime="4.200921118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:27.963304439 +0000 UTC m=+40.779714711" watchObservedRunningTime="2026-07-09 14:03:27.963735472 +0000 UTC m=+40.780145742" Jul 09 14:03:28.933968 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:28.933932 2556 generic.go:356] "Generic (PLEG): container finished" podID="772dfbee-a87a-4c43-a2f7-9179242798b2" containerID="8edf7601462621997d854107d3b13fda5dacf23b0f080219d03f09679d55e387" exitCode=0 Jul 09 14:03:28.934766 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:28.934029 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerDied","Data":"8edf7601462621997d854107d3b13fda5dacf23b0f080219d03f09679d55e387"} Jul 09 14:03:29.939196 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:29.939160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ds25h" event={"ID":"772dfbee-a87a-4c43-a2f7-9179242798b2","Type":"ContainerStarted","Data":"693e5c62a4871c969b5cad6f6a898aca5b0b2c178a8b872e95b2bdf15f6a05eb"} Jul 09 14:03:29.966607 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:29.966560 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ds25h" podStartSLOduration=12.801765489 podStartE2EDuration="41.966545532s" totalImagesPullingTime="29.164780043s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:29.965216542 +0000 UTC m=+42.781626813" watchObservedRunningTime="2026-07-09 14:03:29.966545532 +0000 UTC m=+42.782955803" Jul 09 14:03:30.627399 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.627372 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-czpxj"] Jul 09 14:03:30.651085 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.651061 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-czpxj"] Jul 09 14:03:30.651215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.651173 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.653322 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.653299 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 14:03:30.653322 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.653307 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 14:03:30.653483 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.653307 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 14:03:30.654255 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.654229 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zvwkr\"" Jul 09 14:03:30.654377 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.654229 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 14:03:30.806148 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806107 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.806308 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806166 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-crio-socket\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.806308 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806228 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:30.806308 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.806465 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806317 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7sjc\" (UniqueName: \"kubernetes.io/projected/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-api-access-q7sjc\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.806465 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.806332 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:30.806465 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:30.806465 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.806393 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls podName:3bf72a99-1009-4a83-9ab6-9393ac5b4814 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:38.806377389 +0000 UTC m=+51.622787638 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls") pod "dns-default-h5zc8" (UID: "3bf72a99-1009-4a83-9ab6-9393ac5b4814") : secret "dns-default-metrics-tls" not found Jul 09 14:03:30.806465 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.806411 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-data-volume\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.806465 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.806457 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:03:30.806681 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.806470 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594c756dc4-8cg4d: secret "image-registry-tls" not found Jul 09 14:03:30.806681 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.806523 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls podName:8c4b761e-1c4d-4710-b559-464a67cfef04 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:38.806507286 +0000 UTC m=+51.622917538 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls") pod "image-registry-594c756dc4-8cg4d" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04") : secret "image-registry-tls" not found Jul 09 14:03:30.907817 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.907732 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7sjc\" (UniqueName: \"kubernetes.io/projected/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-api-access-q7sjc\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.907970 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.907819 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-data-volume\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.907970 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.907857 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.907970 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.907893 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-crio-socket\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.907970 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.907967 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.908212 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.907974 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:30.908212 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.908057 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:30.908212 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.908069 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:31.408049163 +0000 UTC m=+44.224459420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:30.908212 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:30.908108 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:31.408094087 +0000 UTC m=+44.224504350 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : configmap "kube-rbac-proxy" not found Jul 09 14:03:30.908212 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.908180 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-crio-socket\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.908388 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.908229 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-data-volume\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:30.917945 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:30.917918 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7sjc\" (UniqueName: \"kubernetes.io/projected/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-api-access-q7sjc\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:31.412516 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.412472 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:31.413039 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.412577 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:31.413039 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:31.412628 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:31.413039 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:31.412689 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:31.413039 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:31.412708 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:32.412687775 +0000 UTC m=+45.229098055 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:31.413039 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:31.412732 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:32.412720146 +0000 UTC m=+45.229130416 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : configmap "kube-rbac-proxy" not found Jul 09 14:03:31.813188 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.813155 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gjqgt"] Jul 09 14:03:31.836076 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.836051 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gjqgt"] Jul 09 14:03:31.836219 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.836168 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:31.838435 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.838411 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 14:03:31.838576 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.838468 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 14:03:31.838576 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.838516 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 14:03:31.839512 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.839492 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2sj66\"" Jul 09 14:03:31.839591 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:31.839514 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 14:03:32.018145 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.018116 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/22f01830-86d0-4ba6-8002-ddca9fadc692-signing-cabundle\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.018145 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.018151 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/22f01830-86d0-4ba6-8002-ddca9fadc692-signing-key\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.018403 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.018181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9clz\" (UniqueName: \"kubernetes.io/projected/22f01830-86d0-4ba6-8002-ddca9fadc692-kube-api-access-g9clz\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.119515 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.119433 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/22f01830-86d0-4ba6-8002-ddca9fadc692-signing-cabundle\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.119515 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.119485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/22f01830-86d0-4ba6-8002-ddca9fadc692-signing-key\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.119684 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.119532 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9clz\" (UniqueName: \"kubernetes.io/projected/22f01830-86d0-4ba6-8002-ddca9fadc692-kube-api-access-g9clz\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.120175 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.120158 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/22f01830-86d0-4ba6-8002-ddca9fadc692-signing-cabundle\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.121881 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.121860 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/22f01830-86d0-4ba6-8002-ddca9fadc692-signing-key\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.127056 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.127034 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9clz\" (UniqueName: \"kubernetes.io/projected/22f01830-86d0-4ba6-8002-ddca9fadc692-kube-api-access-g9clz\") pod \"service-ca-79f68b9f4f-gjqgt\" (UID: \"22f01830-86d0-4ba6-8002-ddca9fadc692\") " pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.144828 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.144801 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" Jul 09 14:03:32.271912 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.271744 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-gjqgt"] Jul 09 14:03:32.275145 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:32.275120 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f01830_86d0_4ba6_8002_ddca9fadc692.slice/crio-0fa44b125ecf11551de360a991d06510122ef47f929ac6b1ba5b57a5cf4e8d6f WatchSource:0}: Error finding container 0fa44b125ecf11551de360a991d06510122ef47f929ac6b1ba5b57a5cf4e8d6f: Status 404 returned error can't find the container with id 0fa44b125ecf11551de360a991d06510122ef47f929ac6b1ba5b57a5cf4e8d6f Jul 09 14:03:32.421280 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.421173 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:32.421280 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.421239 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:32.421673 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:32.421293 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:32.421673 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:32.421339 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:32.421673 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:32.421360 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:34.421341967 +0000 UTC m=+47.237752217 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : configmap "kube-rbac-proxy" not found Jul 09 14:03:32.421673 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:32.421390 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:34.421376409 +0000 UTC m=+47.237786662 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:32.947231 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:32.947181 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" event={"ID":"22f01830-86d0-4ba6-8002-ddca9fadc692","Type":"ContainerStarted","Data":"0fa44b125ecf11551de360a991d06510122ef47f929ac6b1ba5b57a5cf4e8d6f"} Jul 09 14:03:33.615755 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:33.615727 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vwhwx_6afc7b62-c78d-468c-b8d3-e388a2e7c72d/dns-node-resolver/0.log" Jul 09 14:03:34.216594 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:34.216562 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8x95m_d515e7d4-398c-47b2-963d-c7a9f8f83498/node-ca/0.log" Jul 09 14:03:34.437479 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:34.437446 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:34.437673 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:34.437527 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:34.437673 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:34.437571 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:34.437673 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:34.437648 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:38.437624634 +0000 UTC m=+51.254034886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : configmap "kube-rbac-proxy" not found Jul 09 14:03:34.437835 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:34.437689 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:34.437835 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:34.437773 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:38.437753901 +0000 UTC m=+51.254164165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:35.018421 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:35.018384 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4q4vz_7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f/serve-healthcheck-canary/0.log" Jul 09 14:03:35.955097 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:35.955062 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" event={"ID":"22f01830-86d0-4ba6-8002-ddca9fadc692","Type":"ContainerStarted","Data":"632d22ee4b39153544dfca22fc61de4578579098bc052b918d2c47fec0f61f63"} Jul 09 14:03:35.971743 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:35.971700 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-gjqgt" podStartSLOduration=2.024624357 podStartE2EDuration="4.971687019s" totalImagesPullingTime="2.947062662s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:35.970555308 +0000 UTC m=+48.786965580" watchObservedRunningTime="2026-07-09 14:03:35.971687019 +0000 UTC m=+48.788097289" Jul 09 14:03:38.474414 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:38.474379 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:38.474899 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:38.474460 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:38.474899 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.474536 2556 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 14:03:38.474899 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.474541 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:38.474899 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.474601 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:46.474586078 +0000 UTC m=+59.290996333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : configmap "kube-rbac-proxy" not found Jul 09 14:03:38.474899 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.474615 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:03:46.47460946 +0000 UTC m=+59.291019710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:38.877767 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:38.877676 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:38.877767 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:38.877745 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:38.877987 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.877823 2556 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 14:03:38.877987 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.877829 2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 14:03:38.877987 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.877900 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls podName:3bf72a99-1009-4a83-9ab6-9393ac5b4814 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:54.877880962 +0000 UTC m=+67.694291231 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls") pod "dns-default-h5zc8" (UID: "3bf72a99-1009-4a83-9ab6-9393ac5b4814") : secret "dns-default-metrics-tls" not found Jul 09 14:03:38.877987 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.877834 2556 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-594c756dc4-8cg4d: secret "image-registry-tls" not found Jul 09 14:03:38.877987 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:38.877956 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls podName:8c4b761e-1c4d-4710-b559-464a67cfef04 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:54.87794508 +0000 UTC m=+67.694355333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls") pod "image-registry-594c756dc4-8cg4d" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04") : secret "image-registry-tls" not found Jul 09 14:03:46.536842 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:46.536801 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:46.537380 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:46.536887 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:46.537380 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:46.536950 2556 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 14:03:46.537380 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:46.537048 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls podName:3d6a9444-ed1f-430a-a10f-b4696c5ef64b nodeName:}" failed. No retries permitted until 2026-07-09 14:04:02.537001261 +0000 UTC m=+75.353411515 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-czpxj" (UID: "3d6a9444-ed1f-430a-a10f-b4696c5ef64b") : secret "insights-runtime-extractor-tls" not found Jul 09 14:03:46.537487 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:46.537413 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:03:48.919866 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:48.919832 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-db4dx" Jul 09 14:03:53.389623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.389586 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:53.392139 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.392123 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 14:03:53.403603 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.403581 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cfce2ae6-b062-48df-be52-85feb542d036-original-pull-secret\") pod \"global-pull-secret-syncer-rq9hz\" (UID: \"cfce2ae6-b062-48df-be52-85feb542d036\") " pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:53.490612 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.490568 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:53.493137 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.493121 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 14:03:53.503082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.503057 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be-metrics-certs\") pod \"network-metrics-daemon-vwqg5\" (UID: \"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be\") " pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:53.572683 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.572660 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-27nh2\"" Jul 09 14:03:53.577419 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.577406 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-rq9hz" Jul 09 14:03:53.581240 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.581222 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vwqg5" Jul 09 14:03:53.591526 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.591504 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:53.593817 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.593797 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 14:03:53.603823 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.603804 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 14:03:53.615344 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.615313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prvd9\" (UniqueName: \"kubernetes.io/projected/bc2c76d4-49d9-40e9-9063-f589cdad35dd-kube-api-access-prvd9\") pod \"network-check-target-7bfr4\" (UID: \"bc2c76d4-49d9-40e9-9063-f589cdad35dd\") " pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:53.705342 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.705298 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-rq9hz"] Jul 09 14:03:53.708938 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:53.708912 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfce2ae6_b062_48df_be52_85feb542d036.slice/crio-0d6df33860b1b20f8716769a765caebb6018409db3216fae9e30187f42ead466 WatchSource:0}: Error finding container 0d6df33860b1b20f8716769a765caebb6018409db3216fae9e30187f42ead466: Status 404 returned error can't find the container with id 0d6df33860b1b20f8716769a765caebb6018409db3216fae9e30187f42ead466 Jul 09 14:03:53.722872 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.722800 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vwqg5"] Jul 09 14:03:53.724966 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:53.724940 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdfe3c2_6b98_40f4_9e44_3b5e8aeb54be.slice/crio-0a8d55a3cbb9dc464644d2a684b9018675d08a1999fc7987325447eaaad10fa4 WatchSource:0}: Error finding container 0a8d55a3cbb9dc464644d2a684b9018675d08a1999fc7987325447eaaad10fa4: Status 404 returned error can't find the container with id 0a8d55a3cbb9dc464644d2a684b9018675d08a1999fc7987325447eaaad10fa4 Jul 09 14:03:53.865700 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.865674 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wp6bz\"" Jul 09 14:03:53.874465 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.874451 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:03:53.989058 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.989001 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7bfr4"] Jul 09 14:03:53.991735 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:53.991706 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc2c76d4_49d9_40e9_9063_f589cdad35dd.slice/crio-16e4f4eb53ddc8b1a6f609f9155dc27ba9c6306f1afbc9fa22f6221fe2f6c461 WatchSource:0}: Error finding container 16e4f4eb53ddc8b1a6f609f9155dc27ba9c6306f1afbc9fa22f6221fe2f6c461: Status 404 returned error can't find the container with id 16e4f4eb53ddc8b1a6f609f9155dc27ba9c6306f1afbc9fa22f6221fe2f6c461 Jul 09 14:03:53.995741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.995629 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bfr4" event={"ID":"bc2c76d4-49d9-40e9-9063-f589cdad35dd","Type":"ContainerStarted","Data":"16e4f4eb53ddc8b1a6f609f9155dc27ba9c6306f1afbc9fa22f6221fe2f6c461"} Jul 09 14:03:53.996725 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.996701 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vwqg5" event={"ID":"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be","Type":"ContainerStarted","Data":"0a8d55a3cbb9dc464644d2a684b9018675d08a1999fc7987325447eaaad10fa4"} Jul 09 14:03:53.997641 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:53.997620 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq9hz" event={"ID":"cfce2ae6-b062-48df-be52-85feb542d036","Type":"ContainerStarted","Data":"0d6df33860b1b20f8716769a765caebb6018409db3216fae9e30187f42ead466"} Jul 09 14:03:54.833837 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.833805 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn"] Jul 09 14:03:54.835653 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.835631 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:54.840846 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.840756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-slq57\"" Jul 09 14:03:54.840914 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.840756 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 09 14:03:54.841417 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.841393 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 14:03:54.841508 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.841443 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 14:03:54.841579 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.841393 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 14:03:54.854795 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.854748 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn"] Jul 09 14:03:54.861936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.861912 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594c756dc4-8cg4d"] Jul 09 14:03:54.862181 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:54.862156 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" podUID="8c4b761e-1c4d-4710-b559-464a67cfef04" Jul 09 14:03:54.901410 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.901383 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95fdw\" (UniqueName: \"kubernetes.io/projected/a86fe465-5fc8-41a8-95b0-3c012ac2c32f-kube-api-access-95fdw\") pod \"managed-serviceaccount-addon-agent-667d6688db-hg8gn\" (UID: \"a86fe465-5fc8-41a8-95b0-3c012ac2c32f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:54.901521 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.901471 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:54.901521 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.901510 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a86fe465-5fc8-41a8-95b0-3c012ac2c32f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-667d6688db-hg8gn\" (UID: \"a86fe465-5fc8-41a8-95b0-3c012ac2c32f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:54.901638 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.901538 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:54.904340 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.904313 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/3bf72a99-1009-4a83-9ab6-9393ac5b4814-metrics-tls\") pod \"dns-default-h5zc8\" (UID: \"3bf72a99-1009-4a83-9ab6-9393ac5b4814\") " pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:54.904439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.904390 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"image-registry-594c756dc4-8cg4d\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:54.969468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.969437 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6fc5b7b4b6-7klcj"] Jul 09 14:03:54.971750 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.971724 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:54.996074 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:54.996022 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc5b7b4b6-7klcj"] Jul 09 14:03:55.002053 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.001879 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95fdw\" (UniqueName: \"kubernetes.io/projected/a86fe465-5fc8-41a8-95b0-3c012ac2c32f-kube-api-access-95fdw\") pod \"managed-serviceaccount-addon-agent-667d6688db-hg8gn\" (UID: \"a86fe465-5fc8-41a8-95b0-3c012ac2c32f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:55.002053 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.001979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a86fe465-5fc8-41a8-95b0-3c012ac2c32f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-667d6688db-hg8gn\" (UID: \"a86fe465-5fc8-41a8-95b0-3c012ac2c32f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:55.003334 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.003313 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:55.003567 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.003546 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vwqg5" event={"ID":"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be","Type":"ContainerStarted","Data":"e27270824f7682f269f47fc4e8a9572689498b1f60b0078cb97a70d604b1b669"} Jul 09 14:03:55.004759 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.004622 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a86fe465-5fc8-41a8-95b0-3c012ac2c32f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-667d6688db-hg8gn\" (UID: \"a86fe465-5fc8-41a8-95b0-3c012ac2c32f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:55.010189 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.010165 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:55.011390 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.011367 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95fdw\" (UniqueName: \"kubernetes.io/projected/a86fe465-5fc8-41a8-95b0-3c012ac2c32f-kube-api-access-95fdw\") pod \"managed-serviceaccount-addon-agent-667d6688db-hg8gn\" (UID: \"a86fe465-5fc8-41a8-95b0-3c012ac2c32f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:55.103137 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103058 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-certificates\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103137 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103104 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-trusted-ca\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103137 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103118 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s5w7z\"" Jul 09 14:03:55.103391 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103144 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-image-registry-private-configuration\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103391 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103256 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c4b761e-1c4d-4710-b559-464a67cfef04-ca-trust-extracted\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103391 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103328 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-installation-pull-secrets\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103391 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103372 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103588 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103401 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22hmk\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-kube-api-access-22hmk\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103588 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103432 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-bound-sa-token\") pod \"8c4b761e-1c4d-4710-b559-464a67cfef04\" (UID: \"8c4b761e-1c4d-4710-b559-464a67cfef04\") " Jul 09 14:03:55.103588 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103457 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:03:55.103588 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103574 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c4b761e-1c4d-4710-b559-464a67cfef04-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:03:55.103786 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.103712 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:03:55.104065 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104031 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-registry-tls\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104182 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwf2p\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-kube-api-access-gwf2p\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104182 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104143 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84020448-c2b8-4b55-93d7-79764f39ddab-trusted-ca\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104353 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104181 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84020448-c2b8-4b55-93d7-79764f39ddab-ca-trust-extracted\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104353 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104204 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-bound-sa-token\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104353 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104232 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84020448-c2b8-4b55-93d7-79764f39ddab-image-registry-private-configuration\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104353 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104319 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84020448-c2b8-4b55-93d7-79764f39ddab-registry-certificates\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104372 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84020448-c2b8-4b55-93d7-79764f39ddab-installation-pull-secrets\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.104554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104432 2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-certificates\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.104554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104449 2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8c4b761e-1c4d-4710-b559-464a67cfef04-trusted-ca\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.104554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.104466 2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/8c4b761e-1c4d-4710-b559-464a67cfef04-ca-trust-extracted\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.105951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.105927 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:03:55.106079 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.106021 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:03:55.106079 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.106035 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-kube-api-access-22hmk" (OuterVolumeSpecName: "kube-api-access-22hmk") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "kube-api-access-22hmk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:03:55.106286 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.106266 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:03:55.106343 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.106325 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "8c4b761e-1c4d-4710-b559-464a67cfef04" (UID: "8c4b761e-1c4d-4710-b559-464a67cfef04"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:03:55.111439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.111422 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-h5zc8" Jul 09 14:03:55.154619 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.154508 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" Jul 09 14:03:55.205600 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205567 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84020448-c2b8-4b55-93d7-79764f39ddab-ca-trust-extracted\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205680 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205617 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-bound-sa-token\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205680 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205648 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84020448-c2b8-4b55-93d7-79764f39ddab-image-registry-private-configuration\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205780 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205684 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84020448-c2b8-4b55-93d7-79764f39ddab-registry-certificates\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205780 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205729 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84020448-c2b8-4b55-93d7-79764f39ddab-installation-pull-secrets\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205780 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205768 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-registry-tls\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205924 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205795 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwf2p\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-kube-api-access-gwf2p\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205924 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84020448-c2b8-4b55-93d7-79764f39ddab-trusted-ca\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.205924 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205915 2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-image-registry-private-configuration\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.206083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205934 2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-registry-tls\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.206083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205954 2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-bound-sa-token\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.206083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205970 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22hmk\" (UniqueName: \"kubernetes.io/projected/8c4b761e-1c4d-4710-b559-464a67cfef04-kube-api-access-22hmk\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.206083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.205985 2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/8c4b761e-1c4d-4710-b559-464a67cfef04-installation-pull-secrets\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:03:55.207909 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.207855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/84020448-c2b8-4b55-93d7-79764f39ddab-ca-trust-extracted\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.208901 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.208854 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/84020448-c2b8-4b55-93d7-79764f39ddab-registry-certificates\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.211343 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.210928 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/84020448-c2b8-4b55-93d7-79764f39ddab-image-registry-private-configuration\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.211343 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.211302 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-registry-tls\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.211492 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.211457 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/84020448-c2b8-4b55-93d7-79764f39ddab-trusted-ca\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.212784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.212761 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/84020448-c2b8-4b55-93d7-79764f39ddab-installation-pull-secrets\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.216439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.216397 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwf2p\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-kube-api-access-gwf2p\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.216967 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.216946 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/84020448-c2b8-4b55-93d7-79764f39ddab-bound-sa-token\") pod \"image-registry-6fc5b7b4b6-7klcj\" (UID: \"84020448-c2b8-4b55-93d7-79764f39ddab\") " pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.264547 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.263824 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-h5zc8"] Jul 09 14:03:55.267486 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:55.267457 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf72a99_1009_4a83_9ab6_9393ac5b4814.slice/crio-003e88e996b49a0735078a6c737942e2b3d6cbd7b75a780ef0abb046f851d6a3 WatchSource:0}: Error finding container 003e88e996b49a0735078a6c737942e2b3d6cbd7b75a780ef0abb046f851d6a3: Status 404 returned error can't find the container with id 003e88e996b49a0735078a6c737942e2b3d6cbd7b75a780ef0abb046f851d6a3 Jul 09 14:03:55.286155 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.286135 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zggw5\"" Jul 09 14:03:55.294171 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.294140 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:55.312658 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.312633 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn"] Jul 09 14:03:55.316360 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:55.316329 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda86fe465_5fc8_41a8_95b0_3c012ac2c32f.slice/crio-c5654aef338fa8aed3bba5db39315c5a10fc9330bff4d84e53e70223d815cfd0 WatchSource:0}: Error finding container c5654aef338fa8aed3bba5db39315c5a10fc9330bff4d84e53e70223d815cfd0: Status 404 returned error can't find the container with id c5654aef338fa8aed3bba5db39315c5a10fc9330bff4d84e53e70223d815cfd0 Jul 09 14:03:55.428483 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:55.428453 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6fc5b7b4b6-7klcj"] Jul 09 14:03:55.432166 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:03:55.432133 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84020448_c2b8_4b55_93d7_79764f39ddab.slice/crio-a3a1bc7e6b9b73b75c3d3e06587538fed3f665a7ec332f6a53a1e02fda6f32a6 WatchSource:0}: Error finding container a3a1bc7e6b9b73b75c3d3e06587538fed3f665a7ec332f6a53a1e02fda6f32a6: Status 404 returned error can't find the container with id a3a1bc7e6b9b73b75c3d3e06587538fed3f665a7ec332f6a53a1e02fda6f32a6 Jul 09 14:03:56.015794 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.015384 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" event={"ID":"84020448-c2b8-4b55-93d7-79764f39ddab","Type":"ContainerStarted","Data":"a9a982c8e953b56303bc97d1698970192140803440ebeb6a75bd7c68e24e4d2e"} Jul 09 14:03:56.015794 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.015480 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" event={"ID":"84020448-c2b8-4b55-93d7-79764f39ddab","Type":"ContainerStarted","Data":"a3a1bc7e6b9b73b75c3d3e06587538fed3f665a7ec332f6a53a1e02fda6f32a6"} Jul 09 14:03:56.015794 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.015749 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:03:56.019593 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.019563 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h5zc8" event={"ID":"3bf72a99-1009-4a83-9ab6-9393ac5b4814","Type":"ContainerStarted","Data":"003e88e996b49a0735078a6c737942e2b3d6cbd7b75a780ef0abb046f851d6a3"} Jul 09 14:03:56.022292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.022263 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vwqg5" event={"ID":"ffdfe3c2-6b98-40f4-9e44-3b5e8aeb54be","Type":"ContainerStarted","Data":"38afe9b0ae093d05557339dd181b2aeda6d5ea01f3fec77d04a3afdfe8bb4ae4"} Jul 09 14:03:56.024250 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.023808 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-594c756dc4-8cg4d" Jul 09 14:03:56.024250 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.024214 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" event={"ID":"a86fe465-5fc8-41a8-95b0-3c012ac2c32f","Type":"ContainerStarted","Data":"c5654aef338fa8aed3bba5db39315c5a10fc9330bff4d84e53e70223d815cfd0"} Jul 09 14:03:56.041988 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.041933 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" podStartSLOduration=2.041915828 podStartE2EDuration="2.041915828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:56.039942346 +0000 UTC m=+68.856352630" watchObservedRunningTime="2026-07-09 14:03:56.041915828 +0000 UTC m=+68.858326100" Jul 09 14:03:56.057517 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.057460 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vwqg5" podStartSLOduration=66.94155538 podStartE2EDuration="1m8.057441991s" totalImagesPullingTime="1.115886611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:03:56.057313456 +0000 UTC m=+68.873723741" watchObservedRunningTime="2026-07-09 14:03:56.057441991 +0000 UTC m=+68.873852264" Jul 09 14:03:56.084984 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.084957 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-594c756dc4-8cg4d"] Jul 09 14:03:56.088632 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:56.088607 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-594c756dc4-8cg4d"] Jul 09 14:03:57.038476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.038441 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5"] Jul 09 14:03:57.050762 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.050733 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5"] Jul 09 14:03:57.050921 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.050855 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:03:57.053215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.053191 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-x8v5z\"" Jul 09 14:03:57.053427 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.053410 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 14:03:57.122931 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.122897 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/829699e3-e590-4a4c-9f00-5c4e8c7596b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n5nv5\" (UID: \"829699e3-e590-4a4c-9f00-5c4e8c7596b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:03:57.224183 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.224144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/829699e3-e590-4a4c-9f00-5c4e8c7596b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n5nv5\" (UID: \"829699e3-e590-4a4c-9f00-5c4e8c7596b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:03:57.224350 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:57.224309 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 09 14:03:57.224434 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:03:57.224422 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/829699e3-e590-4a4c-9f00-5c4e8c7596b8-tls-certificates podName:829699e3-e590-4a4c-9f00-5c4e8c7596b8 nodeName:}" failed. No retries permitted until 2026-07-09 14:03:57.724400311 +0000 UTC m=+70.540810566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/829699e3-e590-4a4c-9f00-5c4e8c7596b8-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-n5nv5" (UID: "829699e3-e590-4a4c-9f00-5c4e8c7596b8") : secret "prometheus-operator-admission-webhook-tls" not found Jul 09 14:03:57.728117 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.728082 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/829699e3-e590-4a4c-9f00-5c4e8c7596b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n5nv5\" (UID: \"829699e3-e590-4a4c-9f00-5c4e8c7596b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:03:57.730766 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.730742 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/829699e3-e590-4a4c-9f00-5c4e8c7596b8-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-n5nv5\" (UID: \"829699e3-e590-4a4c-9f00-5c4e8c7596b8\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:03:57.754365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.754332 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c4b761e-1c4d-4710-b559-464a67cfef04" path="/var/lib/kubelet/pods/8c4b761e-1c4d-4710-b559-464a67cfef04/volumes" Jul 09 14:03:57.963374 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:03:57.963339 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:04:00.199578 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:00.199495 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5"] Jul 09 14:04:01.046116 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:01.045670 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod829699e3_e590_4a4c_9f00_5c4e8c7596b8.slice/crio-ea3171d9877dc9eca690a159c2c2da889d26d7c04785406bf362336de6621d85 WatchSource:0}: Error finding container ea3171d9877dc9eca690a159c2c2da889d26d7c04785406bf362336de6621d85: Status 404 returned error can't find the container with id ea3171d9877dc9eca690a159c2c2da889d26d7c04785406bf362336de6621d85 Jul 09 14:04:02.046835 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.046806 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7bfr4" event={"ID":"bc2c76d4-49d9-40e9-9063-f589cdad35dd","Type":"ContainerStarted","Data":"8d013ef67414cacdbb686e4c97885eb2841bb1caca149bd3006aec428ce45d40"} Jul 09 14:04:02.047188 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.046927 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:04:02.050813 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.050788 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" event={"ID":"a86fe465-5fc8-41a8-95b0-3c012ac2c32f","Type":"ContainerStarted","Data":"30a9248dc53c622db50c7e01995bebb3f1df521664e6c6b0bfa5951f0568b858"} Jul 09 14:04:02.052849 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.052821 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h5zc8" event={"ID":"3bf72a99-1009-4a83-9ab6-9393ac5b4814","Type":"ContainerStarted","Data":"30386cc41babaa93fafba42563de2b0e999ab0352644a12f405a75ee9e6522af"} Jul 09 14:04:02.052963 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.052866 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-h5zc8" event={"ID":"3bf72a99-1009-4a83-9ab6-9393ac5b4814","Type":"ContainerStarted","Data":"c4131b454d9b65ff4c3a740368f53b028738ab2b94eca956a3b113bee16c5ba8"} Jul 09 14:04:02.052963 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.052891 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-h5zc8" Jul 09 14:04:02.053996 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.053974 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" event={"ID":"829699e3-e590-4a4c-9f00-5c4e8c7596b8","Type":"ContainerStarted","Data":"ea3171d9877dc9eca690a159c2c2da889d26d7c04785406bf362336de6621d85"} Jul 09 14:04:02.055537 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.055518 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-rq9hz" event={"ID":"cfce2ae6-b062-48df-be52-85feb542d036","Type":"ContainerStarted","Data":"c626d27e7bd9584d539372bf92c36143cceb0d47733310aaa317b138a93df3e9"} Jul 09 14:04:02.063880 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.063842 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7bfr4" podStartSLOduration=66.975931589 podStartE2EDuration="1m14.063828595s" totalImagesPullingTime="7.087897006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:02.062668346 +0000 UTC m=+74.879078622" watchObservedRunningTime="2026-07-09 14:04:02.063828595 +0000 UTC m=+74.880238856" Jul 09 14:04:02.079830 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.079790 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-667d6688db-hg8gn" podStartSLOduration=2.331386756 podStartE2EDuration="8.079777537s" totalImagesPullingTime="5.748390781s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:02.078763646 +0000 UTC m=+74.895173918" watchObservedRunningTime="2026-07-09 14:04:02.079777537 +0000 UTC m=+74.896187807" Jul 09 14:04:02.098202 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.098163 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-h5zc8" podStartSLOduration=35.291647953 podStartE2EDuration="40.098149595s" totalImagesPullingTime="4.806501642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:02.096761753 +0000 UTC m=+74.913172026" watchObservedRunningTime="2026-07-09 14:04:02.098149595 +0000 UTC m=+74.914559909" Jul 09 14:04:02.116395 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.116360 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-rq9hz" podStartSLOduration=66.780341836 podStartE2EDuration="1m14.116347047s" totalImagesPullingTime="7.336005211s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:02:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:02.116328714 +0000 UTC m=+74.932738985" watchObservedRunningTime="2026-07-09 14:04:02.116347047 +0000 UTC m=+74.932757318" Jul 09 14:04:02.564877 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.564841 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:04:02.567127 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.567096 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3d6a9444-ed1f-430a-a10f-b4696c5ef64b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-czpxj\" (UID: \"3d6a9444-ed1f-430a-a10f-b4696c5ef64b\") " pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:04:02.761731 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.761702 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zvwkr\"" Jul 09 14:04:02.769628 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.769609 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-czpxj" Jul 09 14:04:02.886738 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:02.886715 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-czpxj"] Jul 09 14:04:02.889086 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:02.889047 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d6a9444_ed1f_430a_a10f_b4696c5ef64b.slice/crio-6cd5e9b7c24283c4a9f4c3d2c0fda4b5a1a38bc22cd2e49d81a95bfa47b713ce WatchSource:0}: Error finding container 6cd5e9b7c24283c4a9f4c3d2c0fda4b5a1a38bc22cd2e49d81a95bfa47b713ce: Status 404 returned error can't find the container with id 6cd5e9b7c24283c4a9f4c3d2c0fda4b5a1a38bc22cd2e49d81a95bfa47b713ce Jul 09 14:04:03.063576 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:03.063539 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" event={"ID":"829699e3-e590-4a4c-9f00-5c4e8c7596b8","Type":"ContainerStarted","Data":"60a46ed6db23bba18facce7e4b0c671306bb0ff4399be749aacef57ec3db042d"} Jul 09 14:04:03.064043 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:03.063628 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:04:03.064805 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:03.064777 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czpxj" event={"ID":"3d6a9444-ed1f-430a-a10f-b4696c5ef64b","Type":"ContainerStarted","Data":"6cd5e9b7c24283c4a9f4c3d2c0fda4b5a1a38bc22cd2e49d81a95bfa47b713ce"} Jul 09 14:04:03.068551 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:03.068529 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" Jul 09 14:04:03.079871 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:03.079834 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-n5nv5" podStartSLOduration=5.110602625 podStartE2EDuration="6.079822361s" totalImagesPullingTime="969.219736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:03.079360671 +0000 UTC m=+75.895770939" watchObservedRunningTime="2026-07-09 14:04:03.079822361 +0000 UTC m=+75.896232631" Jul 09 14:04:04.105741 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.105700 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ktk2r"] Jul 09 14:04:04.107834 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.107802 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.110344 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.110319 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-zskf6\"" Jul 09 14:04:04.110462 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.110368 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 14:04:04.111287 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.111222 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 14:04:04.111287 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.111226 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 14:04:04.111417 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.111231 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 14:04:04.111611 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.111593 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 14:04:04.118735 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.118706 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ktk2r"] Jul 09 14:04:04.178593 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.178561 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.178742 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.178617 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwn7w\" (UniqueName: \"kubernetes.io/projected/1b8643ff-5005-42ac-a08e-8c73a989cc04-kube-api-access-gwn7w\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.178742 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.178664 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b8643ff-5005-42ac-a08e-8c73a989cc04-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.178910 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.178753 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.279605 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.279571 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwn7w\" (UniqueName: \"kubernetes.io/projected/1b8643ff-5005-42ac-a08e-8c73a989cc04-kube-api-access-gwn7w\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.279773 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.279623 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b8643ff-5005-42ac-a08e-8c73a989cc04-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.279773 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.279658 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.279773 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.279695 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.279954 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:04:04.279801 2556 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 14:04:04.279954 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:04:04.279888 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-tls podName:1b8643ff-5005-42ac-a08e-8c73a989cc04 nodeName:}" failed. No retries permitted until 2026-07-09 14:04:04.779865216 +0000 UTC m=+77.596275480 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-tls") pod "prometheus-operator-64785b6675-ktk2r" (UID: "1b8643ff-5005-42ac-a08e-8c73a989cc04") : secret "prometheus-operator-tls" not found Jul 09 14:04:04.280425 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.280404 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1b8643ff-5005-42ac-a08e-8c73a989cc04-metrics-client-ca\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.282057 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.282035 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.288133 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.288094 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwn7w\" (UniqueName: \"kubernetes.io/projected/1b8643ff-5005-42ac-a08e-8c73a989cc04-kube-api-access-gwn7w\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.782872 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.782832 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:04.785460 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:04.785433 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1b8643ff-5005-42ac-a08e-8c73a989cc04-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-ktk2r\" (UID: \"1b8643ff-5005-42ac-a08e-8c73a989cc04\") " pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:05.020289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:05.020244 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" Jul 09 14:04:06.521133 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:06.521094 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-ktk2r"] Jul 09 14:04:06.525181 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:06.525158 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8643ff_5005_42ac_a08e_8c73a989cc04.slice/crio-4fbb6a2d6941dd833703d6eefd30362a76e46accd78765423f8cb937ead1769d WatchSource:0}: Error finding container 4fbb6a2d6941dd833703d6eefd30362a76e46accd78765423f8cb937ead1769d: Status 404 returned error can't find the container with id 4fbb6a2d6941dd833703d6eefd30362a76e46accd78765423f8cb937ead1769d Jul 09 14:04:07.081330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:07.081291 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czpxj" event={"ID":"3d6a9444-ed1f-430a-a10f-b4696c5ef64b","Type":"ContainerStarted","Data":"222f0f85edbe92ebec074cd81f906bd938b14f4c58b5ba2745b396ba548a0c66"} Jul 09 14:04:07.082347 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:07.082324 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" event={"ID":"1b8643ff-5005-42ac-a08e-8c73a989cc04","Type":"ContainerStarted","Data":"4fbb6a2d6941dd833703d6eefd30362a76e46accd78765423f8cb937ead1769d"} Jul 09 14:04:10.095370 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:10.095326 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czpxj" event={"ID":"3d6a9444-ed1f-430a-a10f-b4696c5ef64b","Type":"ContainerStarted","Data":"11efc3276c1dba559db95812deb80650123182b15067d6e2af185fd110054123"} Jul 09 14:04:10.098605 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:10.098513 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" event={"ID":"1b8643ff-5005-42ac-a08e-8c73a989cc04","Type":"ContainerStarted","Data":"226572d2b7b83ebfe8da5f421d88441a6e62074928f64c893d3257f7d61df872"} Jul 09 14:04:10.098605 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:10.098567 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" event={"ID":"1b8643ff-5005-42ac-a08e-8c73a989cc04","Type":"ContainerStarted","Data":"d18df3e409e41493bc3c42a6c77a3b0633a91b2e4e7bf1c554a304d225b460cd"} Jul 09 14:04:12.067328 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.067293 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-h5zc8" Jul 09 14:04:12.085596 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.085540 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-ktk2r" podStartSLOduration=4.648729003 podStartE2EDuration="8.085521024s" totalImagesPullingTime="3.436792021s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:10.116426466 +0000 UTC m=+82.932836738" watchObservedRunningTime="2026-07-09 14:04:12.085521024 +0000 UTC m=+84.901931296" Jul 09 14:04:12.471112 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.471081 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh"] Jul 09 14:04:12.477235 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.477200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.479613 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.479586 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xxj9f"] Jul 09 14:04:12.480116 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.479879 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 14:04:12.480116 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.479926 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 14:04:12.480116 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.479948 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-psm4h\"" Jul 09 14:04:12.483060 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.483040 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.487224 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.486349 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 14:04:12.487224 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.486522 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 14:04:12.487224 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.486792 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t8b2p\"" Jul 09 14:04:12.487224 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.486974 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 14:04:12.487464 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.487269 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh"] Jul 09 14:04:12.539906 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.539876 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88h6b\" (UniqueName: \"kubernetes.io/projected/5520eb18-9b85-4082-bb02-fa3962dc9991-kube-api-access-88h6b\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.540082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.539920 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5520eb18-9b85-4082-bb02-fa3962dc9991-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.540082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.539952 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5520eb18-9b85-4082-bb02-fa3962dc9991-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.540082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.540067 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5520eb18-9b85-4082-bb02-fa3962dc9991-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.641274 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641198 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r72xl\" (UniqueName: \"kubernetes.io/projected/996636c4-7a3e-450f-b425-0ba5d62940a7-kube-api-access-r72xl\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641274 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641243 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5520eb18-9b85-4082-bb02-fa3962dc9991-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641275 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-wtmp\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5520eb18-9b85-4082-bb02-fa3962dc9991-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641358 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-sys\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641382 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-root\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641404 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/996636c4-7a3e-450f-b425-0ba5d62940a7-metrics-client-ca\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641476 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641425 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641485 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88h6b\" (UniqueName: \"kubernetes.io/projected/5520eb18-9b85-4082-bb02-fa3962dc9991-kube-api-access-88h6b\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.641820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641512 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-textfile\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641542 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-tls\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.641820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.641583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5520eb18-9b85-4082-bb02-fa3962dc9991-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.642088 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.642069 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5520eb18-9b85-4082-bb02-fa3962dc9991-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.643797 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.643768 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5520eb18-9b85-4082-bb02-fa3962dc9991-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.643889 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.643774 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5520eb18-9b85-4082-bb02-fa3962dc9991-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.653413 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.653387 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88h6b\" (UniqueName: \"kubernetes.io/projected/5520eb18-9b85-4082-bb02-fa3962dc9991-kube-api-access-88h6b\") pod \"openshift-state-metrics-84bd68b896-tbvfh\" (UID: \"5520eb18-9b85-4082-bb02-fa3962dc9991\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.742161 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742132 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r72xl\" (UniqueName: \"kubernetes.io/projected/996636c4-7a3e-450f-b425-0ba5d62940a7-kube-api-access-r72xl\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742167 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742188 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-wtmp\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742209 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-sys\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742226 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-root\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742242 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/996636c4-7a3e-450f-b425-0ba5d62940a7-metrics-client-ca\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742257 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742278 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-textfile\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-root\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742353 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-tls\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742372 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-sys\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742327 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-wtmp\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742846 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742708 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-textfile\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742846 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742825 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/996636c4-7a3e-450f-b425-0ba5d62940a7-metrics-client-ca\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.742926 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.742841 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-accelerators-collector-config\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.744498 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.744481 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-tls\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.744599 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.744584 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/996636c4-7a3e-450f-b425-0ba5d62940a7-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.749739 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.749717 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r72xl\" (UniqueName: \"kubernetes.io/projected/996636c4-7a3e-450f-b425-0ba5d62940a7-kube-api-access-r72xl\") pod \"node-exporter-xxj9f\" (UID: \"996636c4-7a3e-450f-b425-0ba5d62940a7\") " pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.790692 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.790665 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" Jul 09 14:04:12.796969 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.796947 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xxj9f" Jul 09 14:04:12.806854 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:12.806831 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996636c4_7a3e_450f_b425_0ba5d62940a7.slice/crio-9b146660d7c8ed9c620ef295ba89a75dfd3fdbc238208b4d9f60fe27b23d0970 WatchSource:0}: Error finding container 9b146660d7c8ed9c620ef295ba89a75dfd3fdbc238208b4d9f60fe27b23d0970: Status 404 returned error can't find the container with id 9b146660d7c8ed9c620ef295ba89a75dfd3fdbc238208b4d9f60fe27b23d0970 Jul 09 14:04:12.916138 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:12.916116 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh"] Jul 09 14:04:12.918426 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:12.918399 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5520eb18_9b85_4082_bb02_fa3962dc9991.slice/crio-e50207908589a2de50792f6c2a1632a707ec47e79cf23f58e11412d6e050e74c WatchSource:0}: Error finding container e50207908589a2de50792f6c2a1632a707ec47e79cf23f58e11412d6e050e74c: Status 404 returned error can't find the container with id e50207908589a2de50792f6c2a1632a707ec47e79cf23f58e11412d6e050e74c Jul 09 14:04:13.112337 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.112296 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-czpxj" event={"ID":"3d6a9444-ed1f-430a-a10f-b4696c5ef64b","Type":"ContainerStarted","Data":"8df76189f98f475a9d6d7c45208b31dcb10803d950fbd0392c9aaa92b4b9aa57"} Jul 09 14:04:13.113581 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.113558 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxj9f" event={"ID":"996636c4-7a3e-450f-b425-0ba5d62940a7","Type":"ContainerStarted","Data":"9b146660d7c8ed9c620ef295ba89a75dfd3fdbc238208b4d9f60fe27b23d0970"} Jul 09 14:04:13.115132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.115110 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" event={"ID":"5520eb18-9b85-4082-bb02-fa3962dc9991","Type":"ContainerStarted","Data":"3542ccbce5b04b4a5cc4b5d40e02ace9158022f5c2c3c193fc82f7227712f3d7"} Jul 09 14:04:13.115216 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.115160 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" event={"ID":"5520eb18-9b85-4082-bb02-fa3962dc9991","Type":"ContainerStarted","Data":"6d401e8063c563672a3ecd4bab2e9fb87035cca1a64e7fe8635008fa30e377cd"} Jul 09 14:04:13.115216 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.115180 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" event={"ID":"5520eb18-9b85-4082-bb02-fa3962dc9991","Type":"ContainerStarted","Data":"e50207908589a2de50792f6c2a1632a707ec47e79cf23f58e11412d6e050e74c"} Jul 09 14:04:13.133339 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.133296 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-czpxj" podStartSLOduration=33.861963057 podStartE2EDuration="43.13328259s" totalImagesPullingTime="9.271319533s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:03:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:13.132418498 +0000 UTC m=+85.948828770" watchObservedRunningTime="2026-07-09 14:04:13.13328259 +0000 UTC m=+85.949692860" Jul 09 14:04:13.736986 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.736952 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-4bpcx"] Jul 09 14:04:13.741385 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.741362 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:04:13.741510 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.741457 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:13.744337 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.744314 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5nv4l\"" Jul 09 14:04:13.744610 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.744593 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 14:04:13.744810 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.744782 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 14:04:13.745204 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.745185 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.748728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748489 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 14:04:13.748728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748489 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-bgjks\"" Jul 09 14:04:13.748728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748581 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 14:04:13.748728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748533 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 14:04:13.748977 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748791 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 14:04:13.748977 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748960 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 14:04:13.749120 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748991 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 14:04:13.749484 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.748960 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 14:04:13.749484 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.749286 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 14:04:13.749484 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.749295 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 14:04:13.766503 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.766480 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4bpcx"] Jul 09 14:04:13.768124 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.768103 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:04:13.851777 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.851736 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.851961 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.851788 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.851961 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.851833 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwjg8\" (UniqueName: \"kubernetes.io/projected/c6e2059c-e108-471c-b70f-e2a6106c0486-kube-api-access-wwjg8\") pod \"downloads-68c9cbb497-4bpcx\" (UID: \"c6e2059c-e108-471c-b70f-e2a6106c0486\") " pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:13.851961 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.851915 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852121 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.851968 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-web-config\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852121 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.851999 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852121 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852052 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852121 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852076 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852121 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852146 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852185 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9h26\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-kube-api-access-t9h26\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852229 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-config-out\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852271 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.852523 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.852298 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-config-volume\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.952789 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952752 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.952932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952806 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.952932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952849 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwjg8\" (UniqueName: \"kubernetes.io/projected/c6e2059c-e108-471c-b70f-e2a6106c0486-kube-api-access-wwjg8\") pod \"downloads-68c9cbb497-4bpcx\" (UID: \"c6e2059c-e108-471c-b70f-e2a6106c0486\") " pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:13.952932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952883 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.952932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952909 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-web-config\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952944 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.952980 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:04:13.953000 2556 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953025 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953081 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:04:13.953101 2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls podName:5080ac62-7677-4892-a677-44fe66a4f682 nodeName:}" failed. No retries permitted until 2026-07-09 14:04:14.453068448 +0000 UTC m=+87.269478698 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "5080ac62-7677-4892-a677-44fe66a4f682") : secret "alertmanager-main-tls" not found Jul 09 14:04:13.953165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953147 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953190 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9h26\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-kube-api-access-t9h26\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953220 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-config-out\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953268 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953293 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-config-volume\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953987 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953786 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.953987 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.953924 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.954654 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.954613 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.957631 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.957166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-config-out\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.957631 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.957469 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.957631 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.957497 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-tls-assets\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.958123 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.958102 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.958950 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.958892 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-config-volume\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.960957 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.959151 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.960957 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.960573 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-web-config\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.961267 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.961244 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:13.968334 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.968309 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwjg8\" (UniqueName: \"kubernetes.io/projected/c6e2059c-e108-471c-b70f-e2a6106c0486-kube-api-access-wwjg8\") pod \"downloads-68c9cbb497-4bpcx\" (UID: \"c6e2059c-e108-471c-b70f-e2a6106c0486\") " pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:13.968495 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:13.968477 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9h26\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-kube-api-access-t9h26\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:14.057795 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:14.057712 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:14.336983 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:14.336909 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-4bpcx"] Jul 09 14:04:14.340133 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:14.340103 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e2059c_e108_471c_b70f_e2a6106c0486.slice/crio-a47114101eeba370a44ee3bc323299da0f20d534f0dac26fd91462cf661f379f WatchSource:0}: Error finding container a47114101eeba370a44ee3bc323299da0f20d534f0dac26fd91462cf661f379f: Status 404 returned error can't find the container with id a47114101eeba370a44ee3bc323299da0f20d534f0dac26fd91462cf661f379f Jul 09 14:04:14.457652 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:14.457616 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:14.459902 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:14.459878 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:14.666283 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:14.666200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:04:14.799875 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:14.799855 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:04:14.802183 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:14.802158 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5080ac62_7677_4892_a677_44fe66a4f682.slice/crio-f39c922d2e15c255569cfb63dcb6f11fc74efea6c15a843eebdc3b7a195c2e97 WatchSource:0}: Error finding container f39c922d2e15c255569cfb63dcb6f11fc74efea6c15a843eebdc3b7a195c2e97: Status 404 returned error can't find the container with id f39c922d2e15c255569cfb63dcb6f11fc74efea6c15a843eebdc3b7a195c2e97 Jul 09 14:04:15.124148 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:15.124111 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" event={"ID":"5520eb18-9b85-4082-bb02-fa3962dc9991","Type":"ContainerStarted","Data":"76635cb3a4ff3bff21a6faeecefa91383951ce9f1c84950a88232b1ccc5ad5e9"} Jul 09 14:04:15.125279 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:15.125256 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4bpcx" event={"ID":"c6e2059c-e108-471c-b70f-e2a6106c0486","Type":"ContainerStarted","Data":"a47114101eeba370a44ee3bc323299da0f20d534f0dac26fd91462cf661f379f"} Jul 09 14:04:15.126649 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:15.126629 2556 generic.go:356] "Generic (PLEG): container finished" podID="996636c4-7a3e-450f-b425-0ba5d62940a7" containerID="44799bdbec6466edcf5f7fbe5d7ffa05bee7f868275b5dd7494fe0c19e4f925a" exitCode=0 Jul 09 14:04:15.126725 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:15.126708 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxj9f" event={"ID":"996636c4-7a3e-450f-b425-0ba5d62940a7","Type":"ContainerDied","Data":"44799bdbec6466edcf5f7fbe5d7ffa05bee7f868275b5dd7494fe0c19e4f925a"} Jul 09 14:04:15.127793 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:15.127771 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"f39c922d2e15c255569cfb63dcb6f11fc74efea6c15a843eebdc3b7a195c2e97"} Jul 09 14:04:15.145966 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:15.145926 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-tbvfh" podStartSLOduration=1.973143648 podStartE2EDuration="3.1459123s" totalImagesPullingTime="1.172768652s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:15.144890109 +0000 UTC m=+87.961300381" watchObservedRunningTime="2026-07-09 14:04:15.1459123 +0000 UTC m=+87.962322570" Jul 09 14:04:16.133481 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:16.133444 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxj9f" event={"ID":"996636c4-7a3e-450f-b425-0ba5d62940a7","Type":"ContainerStarted","Data":"11a8807f46e5f4e041434a26140a19a6e78d2bb4a9238fb115e88becfd630de5"} Jul 09 14:04:16.133906 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:16.133520 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xxj9f" event={"ID":"996636c4-7a3e-450f-b425-0ba5d62940a7","Type":"ContainerStarted","Data":"2c52e6049e208305410ede8e3aa5af86e64603f6fbd67600eea698e0d9dce552"} Jul 09 14:04:16.134973 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:16.134943 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082" exitCode=0 Jul 09 14:04:16.135108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:16.135036 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082"} Jul 09 14:04:16.158745 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:16.158700 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xxj9f" podStartSLOduration=2.692976397 podStartE2EDuration="4.15868688s" totalImagesPullingTime="1.390829919s" totalInitContainerRuntime="74.880564ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:16.157872905 +0000 UTC m=+88.974283177" watchObservedRunningTime="2026-07-09 14:04:16.15868688 +0000 UTC m=+88.975097188" Jul 09 14:04:17.033889 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:17.033853 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6fc5b7b4b6-7klcj" Jul 09 14:04:18.146356 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.146324 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590"} Jul 09 14:04:18.146854 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.146408 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8"} Jul 09 14:04:18.146854 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.146453 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21"} Jul 09 14:04:18.146854 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.146496 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6"} Jul 09 14:04:18.146854 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.146534 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb"} Jul 09 14:04:18.727509 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.727071 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:04:18.731993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.731966 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.734669 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.734647 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 14:04:18.734923 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.734863 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 14:04:18.735461 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.735433 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bqqb4\"" Jul 09 14:04:18.735554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.735536 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 14:04:18.735611 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.735561 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 14:04:18.735809 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.735780 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 14:04:18.736597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736143 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 14:04:18.736597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736258 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 14:04:18.736597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736322 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 14:04:18.736597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736427 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 14:04:18.737108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736640 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 14:04:18.737108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736773 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6l9n1ldqi7256\"" Jul 09 14:04:18.737108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.736822 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 14:04:18.737108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.737040 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 14:04:18.737108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.737045 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 14:04:18.739507 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.737646 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 14:04:18.739734 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.739710 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 14:04:18.746923 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.746900 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:04:18.900222 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900189 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-config\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900290 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900318 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900447 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900341 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900447 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900367 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900447 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900407 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dspcf\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-kube-api-access-dspcf\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900447 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900443 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900616 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900472 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900616 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900494 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900616 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900518 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900755 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900716 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900821 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900778 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900937 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900914 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900999 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900957 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.900999 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.900988 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.901132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.901041 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.901132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.901070 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.901132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.901106 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:18.901262 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:18.901133 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002192 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dspcf\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-kube-api-access-dspcf\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002192 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002146 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002192 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002176 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002201 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002225 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002263 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002286 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002317 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002339 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002365 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002392 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002414 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002442 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002465 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002490 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-config\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.002536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002527 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.003193 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002566 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.003193 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002597 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.003193 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.003193 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.002655 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.003722 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.003608 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.006381 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.004515 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.006381 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.004814 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.006381 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.005129 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.006381 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.005418 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.006381 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.006059 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.006381 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.006344 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.007918 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.007893 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.009513 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.009490 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.011272 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-web-config\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.011628 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.011645 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-config\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.011705 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.011759 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.011937 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-config-out\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.012090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.012050 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.013114 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.013059 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.013216 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.013111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.013340 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.013321 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dspcf\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-kube-api-access-dspcf\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.016765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.016711 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.047442 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.047392 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:19.161101 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.161044 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerStarted","Data":"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e"} Jul 09 14:04:19.196585 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.196529 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.637024679 podStartE2EDuration="6.196506133s" totalImagesPullingTime="3.539369145s" totalInitContainerRuntime="20.112309ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:19.194202459 +0000 UTC m=+92.010612732" watchObservedRunningTime="2026-07-09 14:04:19.196506133 +0000 UTC m=+92.012916406" Jul 09 14:04:19.213293 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:19.212564 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:04:19.217263 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:04:19.217218 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e3f876a_3840_4407_be33_a2b1196c5ff4.slice/crio-5a2bf384d46cc4c2f1679ba79b8091a9deff5eedb6289ab10541eabbecefc52e WatchSource:0}: Error finding container 5a2bf384d46cc4c2f1679ba79b8091a9deff5eedb6289ab10541eabbecefc52e: Status 404 returned error can't find the container with id 5a2bf384d46cc4c2f1679ba79b8091a9deff5eedb6289ab10541eabbecefc52e Jul 09 14:04:20.167746 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:20.167712 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" exitCode=0 Jul 09 14:04:20.168226 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:20.167790 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} Jul 09 14:04:20.168226 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:20.167878 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"5a2bf384d46cc4c2f1679ba79b8091a9deff5eedb6289ab10541eabbecefc52e"} Jul 09 14:04:24.192553 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:24.192525 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} Jul 09 14:04:24.192888 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:24.192734 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} Jul 09 14:04:33.067611 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:33.067579 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7bfr4" Jul 09 14:04:34.240000 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.239896 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} Jul 09 14:04:34.240000 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.239987 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} Jul 09 14:04:34.240545 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.240053 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} Jul 09 14:04:34.240545 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.240131 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerStarted","Data":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} Jul 09 14:04:34.242230 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.242200 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-4bpcx" event={"ID":"c6e2059c-e108-471c-b70f-e2a6106c0486","Type":"ContainerStarted","Data":"b3decd523f2828ec9266b60120da8cd67e86ae7c86d7c74b52290edbe730f6d0"} Jul 09 14:04:34.242414 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.242391 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:34.256394 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.256368 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-4bpcx" Jul 09 14:04:34.269950 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.269896 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.8687711179999997 podStartE2EDuration="16.269877278s" totalImagesPullingTime="13.380263003s" totalInitContainerRuntime="20.843157ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:34.268124434 +0000 UTC m=+107.084534707" watchObservedRunningTime="2026-07-09 14:04:34.269877278 +0000 UTC m=+107.086287562" Jul 09 14:04:34.286225 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:34.286176 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-4bpcx" podStartSLOduration=1.869024353 podStartE2EDuration="21.286164614s" totalImagesPullingTime="19.417140261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:04:34.284996799 +0000 UTC m=+107.101407070" watchObservedRunningTime="2026-07-09 14:04:34.286164614 +0000 UTC m=+107.102574886" Jul 09 14:04:39.048548 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:39.048512 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:04:42.565287 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:42.565256 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/init-config-reloader/0.log" Jul 09 14:04:42.766226 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:42.766194 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/alertmanager/0.log" Jul 09 14:04:42.965604 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:42.965574 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/config-reloader/0.log" Jul 09 14:04:43.165207 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:43.165178 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/kube-rbac-proxy-web/0.log" Jul 09 14:04:43.365478 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:43.365407 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/kube-rbac-proxy/0.log" Jul 09 14:04:43.565649 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:43.565620 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/kube-rbac-proxy-metric/0.log" Jul 09 14:04:43.765919 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:43.765895 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_5080ac62-7677-4892-a677-44fe66a4f682/prom-label-proxy/0.log" Jul 09 14:04:46.366134 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:46.366108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxj9f_996636c4-7a3e-450f-b425-0ba5d62940a7/init-textfile/0.log" Jul 09 14:04:46.566773 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:46.566741 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxj9f_996636c4-7a3e-450f-b425-0ba5d62940a7/node-exporter/0.log" Jul 09 14:04:46.765730 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:46.765710 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxj9f_996636c4-7a3e-450f-b425-0ba5d62940a7/kube-rbac-proxy/0.log" Jul 09 14:04:46.966298 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:46.966263 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tbvfh_5520eb18-9b85-4082-bb02-fa3962dc9991/kube-rbac-proxy-main/0.log" Jul 09 14:04:47.164945 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:47.164872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tbvfh_5520eb18-9b85-4082-bb02-fa3962dc9991/kube-rbac-proxy-self/0.log" Jul 09 14:04:47.366520 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:47.366493 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tbvfh_5520eb18-9b85-4082-bb02-fa3962dc9991/openshift-state-metrics/0.log" Jul 09 14:04:47.566836 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:47.566800 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/init-config-reloader/0.log" Jul 09 14:04:47.766563 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:47.766538 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/prometheus/0.log" Jul 09 14:04:47.966220 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:47.966190 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/config-reloader/0.log" Jul 09 14:04:48.166813 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:48.166787 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/thanos-sidecar/0.log" Jul 09 14:04:48.365985 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:48.365903 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/kube-rbac-proxy-web/0.log" Jul 09 14:04:48.566057 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:48.566031 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/kube-rbac-proxy/0.log" Jul 09 14:04:48.767299 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:48.767251 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_7e3f876a-3840-4407-be33-a2b1196c5ff4/kube-rbac-proxy-thanos/0.log" Jul 09 14:04:48.966732 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:48.966707 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ktk2r_1b8643ff-5005-42ac-a08e-8c73a989cc04/prometheus-operator/0.log" Jul 09 14:04:49.165875 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:49.165807 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ktk2r_1b8643ff-5005-42ac-a08e-8c73a989cc04/kube-rbac-proxy/0.log" Jul 09 14:04:49.364894 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:49.364867 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-n5nv5_829699e3-e590-4a4c-9f00-5c4e8c7596b8/prometheus-operator-admission-webhook/0.log" Jul 09 14:04:51.766878 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:51.766845 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-4bpcx_c6e2059c-e108-471c-b70f-e2a6106c0486/download-server/0.log" Jul 09 14:04:52.165617 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:04:52.165538 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4q4vz_7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f/serve-healthcheck-canary/0.log" Jul 09 14:05:19.048483 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:19.048437 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:19.105405 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:19.105382 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:19.440546 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:19.440521 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:32.795187 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795154 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:05:32.795746 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795563 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="alertmanager" containerID="cri-o://91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb" gracePeriod=120 Jul 09 14:05:32.795833 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795776 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy" containerID="cri-o://e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8" gracePeriod=120 Jul 09 14:05:32.795833 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795789 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="prom-label-proxy" containerID="cri-o://ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e" gracePeriod=120 Jul 09 14:05:32.795939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795838 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-metric" containerID="cri-o://bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590" gracePeriod=120 Jul 09 14:05:32.795939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795883 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="config-reloader" containerID="cri-o://1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6" gracePeriod=120 Jul 09 14:05:32.796073 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:32.795962 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-web" containerID="cri-o://bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21" gracePeriod=120 Jul 09 14:05:33.484152 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484120 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e" exitCode=0 Jul 09 14:05:33.484152 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484144 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8" exitCode=0 Jul 09 14:05:33.484152 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484151 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6" exitCode=0 Jul 09 14:05:33.484152 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484157 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb" exitCode=0 Jul 09 14:05:33.484402 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484188 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e"} Jul 09 14:05:33.484402 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484250 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8"} Jul 09 14:05:33.484402 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484276 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6"} Jul 09 14:05:33.484402 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:33.484302 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb"} Jul 09 14:05:34.053027 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.052984 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:05:34.179492 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179397 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-metric\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179492 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179447 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-main-db\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179492 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179475 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179503 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-config-volume\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179529 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-web-config\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179568 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-tls-assets\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179604 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9h26\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-kube-api-access-t9h26\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179644 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179681 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-trusted-ca-bundle\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179708 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-metrics-client-ca\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.179765 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179731 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-cluster-tls-config\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.180207 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179773 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-config-out\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.180207 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179810 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:34.180207 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.179829 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-web\") pod \"5080ac62-7677-4892-a677-44fe66a4f682\" (UID: \"5080ac62-7677-4892-a677-44fe66a4f682\") " Jul 09 14:05:34.180207 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.180165 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-main-db\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.180904 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.180801 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:34.180904 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.180857 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:34.182653 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.182614 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.183105 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.183081 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:34.183405 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.183370 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.183511 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.183465 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.183555 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.183519 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-config-volume" (OuterVolumeSpecName: "config-volume") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.183887 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.183868 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.183963 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.183934 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-kube-api-access-t9h26" (OuterVolumeSpecName: "kube-api-access-t9h26") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "kube-api-access-t9h26". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:34.184061 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.184043 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-config-out" (OuterVolumeSpecName: "config-out") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:34.187269 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.187248 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.194497 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.194474 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-web-config" (OuterVolumeSpecName: "web-config") pod "5080ac62-7677-4892-a677-44fe66a4f682" (UID: "5080ac62-7677-4892-a677-44fe66a4f682"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:34.280827 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280800 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.280827 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280822 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.280827 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280832 2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-config-volume\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280841 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-web-config\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280849 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-tls-assets\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280858 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9h26\" (UniqueName: \"kubernetes.io/projected/5080ac62-7677-4892-a677-44fe66a4f682-kube-api-access-t9h26\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280866 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-main-tls\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280875 2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280885 2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5080ac62-7677-4892-a677-44fe66a4f682-metrics-client-ca\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280893 2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-cluster-tls-config\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280901 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5080ac62-7677-4892-a677-44fe66a4f682-config-out\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.281041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.280909 2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5080ac62-7677-4892-a677-44fe66a4f682-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:34.490728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490684 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590" exitCode=0 Jul 09 14:05:34.490728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490715 2556 generic.go:356] "Generic (PLEG): container finished" podID="5080ac62-7677-4892-a677-44fe66a4f682" containerID="bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21" exitCode=0 Jul 09 14:05:34.490927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490774 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 14:05:34.490927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590"} Jul 09 14:05:34.490927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490885 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21"} Jul 09 14:05:34.490927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490917 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"5080ac62-7677-4892-a677-44fe66a4f682","Type":"ContainerDied","Data":"f39c922d2e15c255569cfb63dcb6f11fc74efea6c15a843eebdc3b7a195c2e97"} Jul 09 14:05:34.491093 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.490952 2556 scope.go:117] "RemoveContainer" containerID="ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e" Jul 09 14:05:34.499346 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.499332 2556 scope.go:117] "RemoveContainer" containerID="bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590" Jul 09 14:05:34.505902 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.505883 2556 scope.go:117] "RemoveContainer" containerID="e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8" Jul 09 14:05:34.512316 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.512302 2556 scope.go:117] "RemoveContainer" containerID="bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21" Jul 09 14:05:34.519299 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.519244 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:05:34.519561 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.519422 2556 scope.go:117] "RemoveContainer" containerID="1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6" Jul 09 14:05:34.526321 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.526282 2556 scope.go:117] "RemoveContainer" containerID="91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb" Jul 09 14:05:34.528971 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.528952 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 14:05:34.533440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.533421 2556 scope.go:117] "RemoveContainer" containerID="a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082" Jul 09 14:05:34.539871 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.539857 2556 scope.go:117] "RemoveContainer" containerID="ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e" Jul 09 14:05:34.540137 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.540117 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e\": container with ID starting with ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e not found: ID does not exist" containerID="ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e" Jul 09 14:05:34.540211 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540148 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e"} err="failed to get container status \"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e\": rpc error: code = NotFound desc = could not find container \"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e\": container with ID starting with ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e not found: ID does not exist" Jul 09 14:05:34.540211 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540193 2556 scope.go:117] "RemoveContainer" containerID="bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590" Jul 09 14:05:34.540438 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.540424 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590\": container with ID starting with bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590 not found: ID does not exist" containerID="bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590" Jul 09 14:05:34.540501 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540446 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590"} err="failed to get container status \"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590\": rpc error: code = NotFound desc = could not find container \"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590\": container with ID starting with bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590 not found: ID does not exist" Jul 09 14:05:34.540501 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540467 2556 scope.go:117] "RemoveContainer" containerID="e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8" Jul 09 14:05:34.540690 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.540674 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8\": container with ID starting with e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8 not found: ID does not exist" containerID="e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8" Jul 09 14:05:34.540759 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540697 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8"} err="failed to get container status \"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8\": rpc error: code = NotFound desc = could not find container \"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8\": container with ID starting with e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8 not found: ID does not exist" Jul 09 14:05:34.540759 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540717 2556 scope.go:117] "RemoveContainer" containerID="bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21" Jul 09 14:05:34.540953 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.540929 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21\": container with ID starting with bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21 not found: ID does not exist" containerID="bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21" Jul 09 14:05:34.541024 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540960 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21"} err="failed to get container status \"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21\": rpc error: code = NotFound desc = could not find container \"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21\": container with ID starting with bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21 not found: ID does not exist" Jul 09 14:05:34.541024 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.540978 2556 scope.go:117] "RemoveContainer" containerID="1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6" Jul 09 14:05:34.541232 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.541214 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6\": container with ID starting with 1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6 not found: ID does not exist" containerID="1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6" Jul 09 14:05:34.541286 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541235 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6"} err="failed to get container status \"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6\": rpc error: code = NotFound desc = could not find container \"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6\": container with ID starting with 1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6 not found: ID does not exist" Jul 09 14:05:34.541286 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541251 2556 scope.go:117] "RemoveContainer" containerID="91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb" Jul 09 14:05:34.541453 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.541434 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb\": container with ID starting with 91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb not found: ID does not exist" containerID="91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb" Jul 09 14:05:34.541487 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541458 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb"} err="failed to get container status \"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb\": rpc error: code = NotFound desc = could not find container \"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb\": container with ID starting with 91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb not found: ID does not exist" Jul 09 14:05:34.541487 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541472 2556 scope.go:117] "RemoveContainer" containerID="a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082" Jul 09 14:05:34.541669 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:34.541654 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082\": container with ID starting with a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082 not found: ID does not exist" containerID="a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082" Jul 09 14:05:34.541711 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541673 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082"} err="failed to get container status \"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082\": rpc error: code = NotFound desc = could not find container \"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082\": container with ID starting with a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082 not found: ID does not exist" Jul 09 14:05:34.541711 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541685 2556 scope.go:117] "RemoveContainer" containerID="ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e" Jul 09 14:05:34.541927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541910 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e"} err="failed to get container status \"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e\": rpc error: code = NotFound desc = could not find container \"ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e\": container with ID starting with ffd8c2eb9943fac6a262a86fb0400a0d61bc5a7b89ba55e877ebf2d9bb03827e not found: ID does not exist" Jul 09 14:05:34.541927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.541926 2556 scope.go:117] "RemoveContainer" containerID="bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590" Jul 09 14:05:34.542153 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542130 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590"} err="failed to get container status \"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590\": rpc error: code = NotFound desc = could not find container \"bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590\": container with ID starting with bc42fadc7521e1d27751bf480214497c9d09868fe283951cee30b2096a9d5590 not found: ID does not exist" Jul 09 14:05:34.542153 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542151 2556 scope.go:117] "RemoveContainer" containerID="e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8" Jul 09 14:05:34.542365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542347 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8"} err="failed to get container status \"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8\": rpc error: code = NotFound desc = could not find container \"e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8\": container with ID starting with e3f86ad3e5dcc87d2df84174ca83068ff4bcbcb70501effef012c6f7462e48e8 not found: ID does not exist" Jul 09 14:05:34.542409 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542369 2556 scope.go:117] "RemoveContainer" containerID="bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21" Jul 09 14:05:34.542575 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542552 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21"} err="failed to get container status \"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21\": rpc error: code = NotFound desc = could not find container \"bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21\": container with ID starting with bb3eb3b5b729573c4213a6c7e5c2f0f3521f9c150ef6368f2cb41e40aeb42a21 not found: ID does not exist" Jul 09 14:05:34.542623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542575 2556 scope.go:117] "RemoveContainer" containerID="1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6" Jul 09 14:05:34.542794 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542773 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6"} err="failed to get container status \"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6\": rpc error: code = NotFound desc = could not find container \"1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6\": container with ID starting with 1d55f2706e06bbe43cb86e7a6f2e1772d1faca874dca96d8adab21eb2942bfa6 not found: ID does not exist" Jul 09 14:05:34.542843 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.542795 2556 scope.go:117] "RemoveContainer" containerID="91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb" Jul 09 14:05:34.543034 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.543017 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb"} err="failed to get container status \"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb\": rpc error: code = NotFound desc = could not find container \"91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb\": container with ID starting with 91205dea6a04969824056f4c4ebcb9e09b5c23fed6bb7b9332b9a42f5da504bb not found: ID does not exist" Jul 09 14:05:34.543081 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.543035 2556 scope.go:117] "RemoveContainer" containerID="a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082" Jul 09 14:05:34.543258 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:34.543242 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082"} err="failed to get container status \"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082\": rpc error: code = NotFound desc = could not find container \"a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082\": container with ID starting with a070c36147d6a67f1b07db19e9121113e7c42b6e50b9ee45e6e7a16fad073082 not found: ID does not exist" Jul 09 14:05:35.754270 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:35.754231 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5080ac62-7677-4892-a677-44fe66a4f682" path="/var/lib/kubelet/pods/5080ac62-7677-4892-a677-44fe66a4f682/volumes" Jul 09 14:05:37.115396 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.115356 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:05:37.115874 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.115742 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="prometheus" containerID="cri-o://1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" gracePeriod=600 Jul 09 14:05:37.115932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.115909 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-web" containerID="cri-o://31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" gracePeriod=600 Jul 09 14:05:37.115932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.115909 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy" containerID="cri-o://4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" gracePeriod=600 Jul 09 14:05:37.116046 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.115997 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="thanos-sidecar" containerID="cri-o://5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" gracePeriod=600 Jul 09 14:05:37.116103 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.116087 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" gracePeriod=600 Jul 09 14:05:37.116158 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.116091 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="config-reloader" containerID="cri-o://ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" gracePeriod=600 Jul 09 14:05:37.368848 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.368785 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:37.509029 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.508987 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-grpc-tls\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509208 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509048 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-config-out\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509208 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509139 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-db\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509208 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509185 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-metrics-client-certs\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509231 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-kubelet-serving-ca-bundle\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509253 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-kube-rbac-proxy\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509277 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-metrics-client-ca\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509304 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-config\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509332 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-trusted-ca-bundle\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509374 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-tls-assets\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509398 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509426 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-tls\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509455 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dspcf\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-kube-api-access-dspcf\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509490 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509486 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" exitCode=0 Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509507 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" exitCode=0 Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509518 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" exitCode=0 Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509523 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-serving-certs-ca-bundle\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509529 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" exitCode=0 Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509539 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" exitCode=0 Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509548 2556 generic.go:356] "Generic (PLEG): container finished" podID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" exitCode=0 Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509549 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-0\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509586 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-1\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509609 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-2\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} Jul 09 14:05:37.509657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509653 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-thanos-prometheus-http-client-file\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509681 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509723 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509767 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509805 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509848 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509890 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"7e3f876a-3840-4407-be33-a2b1196c5ff4","Type":"ContainerDied","Data":"5a2bf384d46cc4c2f1679ba79b8091a9deff5eedb6289ab10541eabbecefc52e"} Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509682 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-web-config\") pod \"7e3f876a-3840-4407-be33-a2b1196c5ff4\" (UID: \"7e3f876a-3840-4407-be33-a2b1196c5ff4\") " Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.509944 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:37.510429 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.510219 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.510848 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.510432 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:37.510848 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.510705 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.511686 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.511054 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.511686 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.511340 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.511686 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.511567 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.512031 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.512330 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.512455 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-config-out" (OuterVolumeSpecName: "config-out") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.512697 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.512761 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.512811 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-config" (OuterVolumeSpecName: "config") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.513213 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.513151 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:05:37.513795 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.513771 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.514702 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.514674 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.514808 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.514780 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.515144 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.515106 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-kube-api-access-dspcf" (OuterVolumeSpecName: "kube-api-access-dspcf") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "kube-api-access-dspcf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:37.515366 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.515326 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.515464 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.515406 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:05:37.516056 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.516034 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.520859 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.520840 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.522910 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.522889 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-web-config" (OuterVolumeSpecName: "web-config") pod "7e3f876a-3840-4407-be33-a2b1196c5ff4" (UID: "7e3f876a-3840-4407-be33-a2b1196c5ff4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:05:37.527146 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.527132 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.533587 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.533566 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.540630 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.540593 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.546727 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.546708 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.553125 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.553107 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.559132 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559116 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.559389 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.559369 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.559440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559398 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} err="failed to get container status \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" Jul 09 14:05:37.559440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559415 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.559636 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.559618 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.559678 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559641 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} err="failed to get container status \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" Jul 09 14:05:37.559678 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559654 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.559839 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.559824 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.559879 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559843 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} err="failed to get container status \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" Jul 09 14:05:37.559879 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.559857 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.560061 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.560039 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.560142 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560063 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} err="failed to get container status \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" Jul 09 14:05:37.560142 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560080 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.560317 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.560303 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.560359 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560319 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} err="failed to get container status \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" Jul 09 14:05:37.560359 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560330 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.560542 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.560528 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.560580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560544 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} err="failed to get container status \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" Jul 09 14:05:37.560580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560555 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.560767 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:05:37.560750 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.560805 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560773 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} err="failed to get container status \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" Jul 09 14:05:37.560805 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560788 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.560984 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560966 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} err="failed to get container status \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" Jul 09 14:05:37.561058 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.560984 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.561224 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561208 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} err="failed to get container status \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" Jul 09 14:05:37.561269 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561225 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.561425 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561408 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} err="failed to get container status \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" Jul 09 14:05:37.561468 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561425 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.561643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561626 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} err="failed to get container status \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" Jul 09 14:05:37.561689 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561643 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.561839 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561815 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} err="failed to get container status \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" Jul 09 14:05:37.561875 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561840 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.561997 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561980 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} err="failed to get container status \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" Jul 09 14:05:37.562057 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.561996 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.562181 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562162 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} err="failed to get container status \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" Jul 09 14:05:37.562237 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562185 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.562386 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562369 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} err="failed to get container status \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" Jul 09 14:05:37.562428 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562388 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.562576 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562560 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} err="failed to get container status \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" Jul 09 14:05:37.562622 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562576 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.562783 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562768 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} err="failed to get container status \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" Jul 09 14:05:37.562783 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562783 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.562974 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562957 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} err="failed to get container status \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" Jul 09 14:05:37.563030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.562974 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.563153 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563138 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} err="failed to get container status \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" Jul 09 14:05:37.563153 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563152 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.563327 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563312 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} err="failed to get container status \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" Jul 09 14:05:37.563368 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563328 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.563516 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563498 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} err="failed to get container status \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" Jul 09 14:05:37.563554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563517 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.563693 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563676 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} err="failed to get container status \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" Jul 09 14:05:37.563742 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563693 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.563851 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563837 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} err="failed to get container status \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" Jul 09 14:05:37.563894 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.563850 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.564102 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564037 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} err="failed to get container status \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" Jul 09 14:05:37.564102 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564060 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.564278 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564261 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} err="failed to get container status \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" Jul 09 14:05:37.564358 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564278 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.564470 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564452 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} err="failed to get container status \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" Jul 09 14:05:37.564511 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564470 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.564734 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564715 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} err="failed to get container status \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" Jul 09 14:05:37.564734 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564734 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.564960 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564934 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} err="failed to get container status \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" Jul 09 14:05:37.565018 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.564960 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.565181 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565163 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} err="failed to get container status \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" Jul 09 14:05:37.565230 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565182 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.565375 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565361 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} err="failed to get container status \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" Jul 09 14:05:37.565418 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565374 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.565564 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565550 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} err="failed to get container status \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" Jul 09 14:05:37.565564 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565564 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.565734 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565720 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} err="failed to get container status \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" Jul 09 14:05:37.565734 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565733 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.565912 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565897 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} err="failed to get container status \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" Jul 09 14:05:37.565912 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.565910 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.566107 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566090 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} err="failed to get container status \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" Jul 09 14:05:37.566147 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566109 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.566304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566288 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} err="failed to get container status \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" Jul 09 14:05:37.566304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566303 2556 scope.go:117] "RemoveContainer" containerID="a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a" Jul 09 14:05:37.566504 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566487 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a"} err="failed to get container status \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": rpc error: code = NotFound desc = could not find container \"a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a\": container with ID starting with a384b7eb10f15633b81ab878e9eae8b3c778652179405353a22edd42b2a9143a not found: ID does not exist" Jul 09 14:05:37.566553 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566503 2556 scope.go:117] "RemoveContainer" containerID="4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f" Jul 09 14:05:37.566740 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566724 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f"} err="failed to get container status \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": rpc error: code = NotFound desc = could not find container \"4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f\": container with ID starting with 4d4da3a70133d115b01312fa1141f5d40c19115d8390d36d0ab0e54b9e4a1a0f not found: ID does not exist" Jul 09 14:05:37.566777 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566740 2556 scope.go:117] "RemoveContainer" containerID="31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd" Jul 09 14:05:37.566909 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566893 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd"} err="failed to get container status \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": rpc error: code = NotFound desc = could not find container \"31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd\": container with ID starting with 31a5506608c78fd2ed6e77fe9e0add682d0640fd9c2ce400439afc5f2562acbd not found: ID does not exist" Jul 09 14:05:37.566950 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.566909 2556 scope.go:117] "RemoveContainer" containerID="5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637" Jul 09 14:05:37.567089 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567073 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637"} err="failed to get container status \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": rpc error: code = NotFound desc = could not find container \"5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637\": container with ID starting with 5175f52a7072d7fb07ae23ef047cd20fcd826286a8c7e8dae6c49c62c2c23637 not found: ID does not exist" Jul 09 14:05:37.567089 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567089 2556 scope.go:117] "RemoveContainer" containerID="ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0" Jul 09 14:05:37.567263 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567248 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0"} err="failed to get container status \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": rpc error: code = NotFound desc = could not find container \"ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0\": container with ID starting with ace79d043d823ccf66e0dc41b4f4c8f3fb651c64a5901971142a505737b0c5a0 not found: ID does not exist" Jul 09 14:05:37.567301 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567264 2556 scope.go:117] "RemoveContainer" containerID="1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647" Jul 09 14:05:37.567464 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567447 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647"} err="failed to get container status \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": rpc error: code = NotFound desc = could not find container \"1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647\": container with ID starting with 1376cb89e486e17e3c3a1857b8e17d458b15bb88a05f21daa98b9d849ef63647 not found: ID does not exist" Jul 09 14:05:37.567527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567464 2556 scope.go:117] "RemoveContainer" containerID="6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47" Jul 09 14:05:37.567653 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.567632 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47"} err="failed to get container status \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": rpc error: code = NotFound desc = could not find container \"6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47\": container with ID starting with 6cb5b51b949f5f57fe1aebf483d757a19b6da47f45d1ba25f2c2841e2de33c47 not found: ID does not exist" Jul 09 14:05:37.611052 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611026 2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-config\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611052 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611050 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611060 2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-tls-assets\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611071 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611080 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611088 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dspcf\" (UniqueName: \"kubernetes.io/projected/7e3f876a-3840-4407-be33-a2b1196c5ff4-kube-api-access-dspcf\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611097 2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611118 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611127 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611136 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611145 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611153 2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611178 2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-web-config\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611186 2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-grpc-tls\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611193 2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-config-out\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611201 2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/7e3f876a-3840-4407-be33-a2b1196c5ff4-prometheus-k8s-db\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611208 2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-metrics-client-certs\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611216 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611224 2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7e3f876a-3840-4407-be33-a2b1196c5ff4-secret-kube-rbac-proxy\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.611433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.611233 2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7e3f876a-3840-4407-be33-a2b1196c5ff4-configmap-metrics-client-ca\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:05:37.829699 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.829669 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:05:37.834851 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.834828 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:05:37.860595 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860562 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:05:37.860811 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860799 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="config-reloader" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860812 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="config-reloader" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860820 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="prom-label-proxy" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860826 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="prom-label-proxy" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860834 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="alertmanager" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860839 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="alertmanager" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860847 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-web" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860852 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-web" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860858 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="prometheus" Jul 09 14:05:37.860867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860864 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="prometheus" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860875 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860880 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860888 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-web" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860893 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-web" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860898 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-metric" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860903 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-metric" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860910 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="init-config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860916 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="init-config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860924 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860928 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860934 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="thanos-sidecar" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860947 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="thanos-sidecar" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860955 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="init-config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860960 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="init-config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860965 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860971 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860976 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-thanos" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.860981 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-thanos" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861034 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861042 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="alertmanager" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861048 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861055 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-web" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861060 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861065 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="config-reloader" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861070 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="prometheus" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861076 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-web" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861080 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="kube-rbac-proxy-thanos" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861086 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="prom-label-proxy" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861092 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" containerName="thanos-sidecar" Jul 09 14:05:37.861177 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.861097 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5080ac62-7677-4892-a677-44fe66a4f682" containerName="kube-rbac-proxy-metric" Jul 09 14:05:37.864719 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.864699 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:37.867580 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.867560 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 14:05:37.867881 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.867861 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 14:05:37.867950 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.867888 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 14:05:37.867950 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.867941 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-bqqb4\"" Jul 09 14:05:37.868090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868079 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 14:05:37.868148 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868123 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 14:05:37.868240 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868224 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 14:05:37.868553 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868537 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 14:05:37.868596 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868576 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 14:05:37.868817 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868800 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 14:05:37.868873 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868837 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 14:05:37.868994 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868962 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 14:05:37.868994 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.868980 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 14:05:37.869274 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.869260 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 14:05:37.870975 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.870201 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6l9n1ldqi7256\"" Jul 09 14:05:37.876148 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.876123 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 14:05:37.878617 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.878595 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 14:05:37.881572 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:37.881550 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:05:38.014448 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014349 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d396f360-e05f-473a-bf09-621c6068626d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014448 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014392 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014448 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014417 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014448 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014445 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014477 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d396f360-e05f-473a-bf09-621c6068626d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014497 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014526 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014552 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-config\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014577 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014621 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014656 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.014751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014713 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014760 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014779 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014794 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5psdn\" (UniqueName: \"kubernetes.io/projected/d396f360-e05f-473a-bf09-621c6068626d-kube-api-access-5psdn\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014821 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014853 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014867 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014887 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.015030 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.014905 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.115534 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115488 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.115534 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115537 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115570 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115590 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115607 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5psdn\" (UniqueName: \"kubernetes.io/projected/d396f360-e05f-473a-bf09-621c6068626d-kube-api-access-5psdn\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115627 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115646 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115712 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115760 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115793 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115829 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d396f360-e05f-473a-bf09-621c6068626d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115855 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115880 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115909 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115945 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d396f360-e05f-473a-bf09-621c6068626d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115966 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.115995 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.116056 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-config\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116084 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.116084 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.116113 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.116478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.116484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.116884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.116764 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.117260 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.117239 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.117347 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.117283 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.117970 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.117946 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.119119 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.118773 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.119119 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.118847 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.119119 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.118901 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.119119 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.119060 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d396f360-e05f-473a-bf09-621c6068626d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.119370 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.119339 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.119857 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.119826 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-web-config\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.120066 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.120041 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d396f360-e05f-473a-bf09-621c6068626d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.120176 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.120152 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.120440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.120422 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-config\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.121253 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.121230 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.121402 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.121380 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d396f360-e05f-473a-bf09-621c6068626d-config-out\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.121565 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.121548 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.121730 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.121713 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d396f360-e05f-473a-bf09-621c6068626d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.125436 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.125417 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5psdn\" (UniqueName: \"kubernetes.io/projected/d396f360-e05f-473a-bf09-621c6068626d-kube-api-access-5psdn\") pod \"prometheus-k8s-0\" (UID: \"d396f360-e05f-473a-bf09-621c6068626d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.176391 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.176366 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:05:38.314034 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.313936 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 14:05:38.316796 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:05:38.316768 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd396f360_e05f_473a_bf09_621c6068626d.slice/crio-7c9df700b1e2795984da4fa453e6d625b0b89fda62d55c4094933eaa062a7ef4 WatchSource:0}: Error finding container 7c9df700b1e2795984da4fa453e6d625b0b89fda62d55c4094933eaa062a7ef4: Status 404 returned error can't find the container with id 7c9df700b1e2795984da4fa453e6d625b0b89fda62d55c4094933eaa062a7ef4 Jul 09 14:05:38.514949 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.514916 2556 generic.go:356] "Generic (PLEG): container finished" podID="d396f360-e05f-473a-bf09-621c6068626d" containerID="9033f189d202223d4563eae7a8cf4ac349d6d3d61a03b3df7834fed9fd336d6b" exitCode=0 Jul 09 14:05:38.515131 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.515025 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerDied","Data":"9033f189d202223d4563eae7a8cf4ac349d6d3d61a03b3df7834fed9fd336d6b"} Jul 09 14:05:38.515131 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:38.515114 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"7c9df700b1e2795984da4fa453e6d625b0b89fda62d55c4094933eaa062a7ef4"} Jul 09 14:05:39.523044 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.522991 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"ad7490b5a3b8caed75ef82d669db014c9d0db63600ef2ea8eba8df47eb13e897"} Jul 09 14:05:39.523505 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.523074 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"07be8d10695ec136e808037db4fa5f6971bdde4ef3ebecf620bb2d6c5ab87c04"} Jul 09 14:05:39.523505 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.523099 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"03d26fbc78938d2357b8570a0aea39e3fbc2b26eef194c7f604506611e9fb6ee"} Jul 09 14:05:39.523505 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.523122 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"9b8638318593f8cbb6d5234699f33ead8e25bcdd263a9916e83dcec13353c0ea"} Jul 09 14:05:39.523505 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.523147 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"245d57736249221bafe2c5b77705648bb69cbb46f51f21eb4485d0564c88f11a"} Jul 09 14:05:39.523505 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.523170 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d396f360-e05f-473a-bf09-621c6068626d","Type":"ContainerStarted","Data":"afc7e1b90f927f7138212cc9bbe35805e8f9ec193800e573e49134a463468d5c"} Jul 09 14:05:39.558559 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.558504 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.538972138 podStartE2EDuration="2.558488818s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.51668ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:05:39.556302294 +0000 UTC m=+172.372712566" watchObservedRunningTime="2026-07-09 14:05:39.558488818 +0000 UTC m=+172.374899089" Jul 09 14:05:39.755434 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:39.755403 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e3f876a-3840-4407-be33-a2b1196c5ff4" path="/var/lib/kubelet/pods/7e3f876a-3840-4407-be33-a2b1196c5ff4/volumes" Jul 09 14:05:43.176752 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:05:43.176706 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:06:38.177146 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:06:38.177114 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:06:38.192090 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:06:38.192066 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:06:38.755589 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:06:38.755564 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 14:07:47.577314 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:07:47.577263 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:07:47.586357 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:07:47.586333 2556 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 14:07:47.587771 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:07:47.587753 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:08:38.358300 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.358269 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k"] Jul 09 14:08:38.360352 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.360336 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.362712 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.362685 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 14:08:38.363483 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.363466 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-dnnjh\"" Jul 09 14:08:38.363542 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.363504 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 14:08:38.370283 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.370264 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k"] Jul 09 14:08:38.516743 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.516702 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a531d688-ece0-4046-a6e0-dd2c6fecc663-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hzm7k\" (UID: \"a531d688-ece0-4046-a6e0-dd2c6fecc663\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.516990 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.516792 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wd9j\" (UniqueName: \"kubernetes.io/projected/a531d688-ece0-4046-a6e0-dd2c6fecc663-kube-api-access-2wd9j\") pod \"openshift-lws-operator-fd8ccff4c-hzm7k\" (UID: \"a531d688-ece0-4046-a6e0-dd2c6fecc663\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.617247 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.617156 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a531d688-ece0-4046-a6e0-dd2c6fecc663-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hzm7k\" (UID: \"a531d688-ece0-4046-a6e0-dd2c6fecc663\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.617247 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.617240 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wd9j\" (UniqueName: \"kubernetes.io/projected/a531d688-ece0-4046-a6e0-dd2c6fecc663-kube-api-access-2wd9j\") pod \"openshift-lws-operator-fd8ccff4c-hzm7k\" (UID: \"a531d688-ece0-4046-a6e0-dd2c6fecc663\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.617507 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.617486 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a531d688-ece0-4046-a6e0-dd2c6fecc663-tmp\") pod \"openshift-lws-operator-fd8ccff4c-hzm7k\" (UID: \"a531d688-ece0-4046-a6e0-dd2c6fecc663\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.627944 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.627919 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wd9j\" (UniqueName: \"kubernetes.io/projected/a531d688-ece0-4046-a6e0-dd2c6fecc663-kube-api-access-2wd9j\") pod \"openshift-lws-operator-fd8ccff4c-hzm7k\" (UID: \"a531d688-ece0-4046-a6e0-dd2c6fecc663\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.669364 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.669334 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" Jul 09 14:08:38.803647 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.803459 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k"] Jul 09 14:08:38.806327 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:08:38.806302 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda531d688_ece0_4046_a6e0_dd2c6fecc663.slice/crio-5209f458b6724d515a27e401ffe92f1b485a0c3fa50f239a77c7074e38705606 WatchSource:0}: Error finding container 5209f458b6724d515a27e401ffe92f1b485a0c3fa50f239a77c7074e38705606: Status 404 returned error can't find the container with id 5209f458b6724d515a27e401ffe92f1b485a0c3fa50f239a77c7074e38705606 Jul 09 14:08:38.808314 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:38.808296 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:08:39.158469 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:39.158386 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" event={"ID":"a531d688-ece0-4046-a6e0-dd2c6fecc663","Type":"ContainerStarted","Data":"5209f458b6724d515a27e401ffe92f1b485a0c3fa50f239a77c7074e38705606"} Jul 09 14:08:44.178373 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:44.178338 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" event={"ID":"a531d688-ece0-4046-a6e0-dd2c6fecc663","Type":"ContainerStarted","Data":"6eb62137692edbb2e491be44ced44cb67c89ba7549cc4c41233923ae39aa6583"} Jul 09 14:08:44.199244 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:44.199188 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-hzm7k" podStartSLOduration=1.018359184 podStartE2EDuration="6.199169313s" totalImagesPullingTime="5.180810129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:08:44.198207525 +0000 UTC m=+357.014617795" watchObservedRunningTime="2026-07-09 14:08:44.199169313 +0000 UTC m=+357.015579587" Jul 09 14:08:57.196286 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.196251 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf"] Jul 09 14:08:57.198798 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.198779 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.202314 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.202279 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 09 14:08:57.202314 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.202279 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 09 14:08:57.202485 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.202369 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9js8j\"" Jul 09 14:08:57.202485 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.202374 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 09 14:08:57.208953 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.208917 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf"] Jul 09 14:08:57.283159 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.283124 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xbk8\" (UniqueName: \"kubernetes.io/projected/8629163e-4557-4ff7-bbe1-12276f74a2b7-kube-api-access-7xbk8\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.283330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.283175 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8629163e-4557-4ff7-bbe1-12276f74a2b7-metrics-cert\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.283330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.283235 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8629163e-4557-4ff7-bbe1-12276f74a2b7-cert\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.283330 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.283262 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8629163e-4557-4ff7-bbe1-12276f74a2b7-manager-config\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.384511 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.384476 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xbk8\" (UniqueName: \"kubernetes.io/projected/8629163e-4557-4ff7-bbe1-12276f74a2b7-kube-api-access-7xbk8\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.384672 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.384523 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8629163e-4557-4ff7-bbe1-12276f74a2b7-metrics-cert\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.384672 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.384564 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8629163e-4557-4ff7-bbe1-12276f74a2b7-cert\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.384672 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.384583 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8629163e-4557-4ff7-bbe1-12276f74a2b7-manager-config\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.385307 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.385281 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8629163e-4557-4ff7-bbe1-12276f74a2b7-manager-config\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.387028 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.386990 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8629163e-4557-4ff7-bbe1-12276f74a2b7-metrics-cert\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.387186 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.387166 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8629163e-4557-4ff7-bbe1-12276f74a2b7-cert\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.399214 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.399195 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xbk8\" (UniqueName: \"kubernetes.io/projected/8629163e-4557-4ff7-bbe1-12276f74a2b7-kube-api-access-7xbk8\") pod \"lws-controller-manager-677b74f79f-cmwqf\" (UID: \"8629163e-4557-4ff7-bbe1-12276f74a2b7\") " pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.507648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.507577 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:08:57.630659 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:57.630632 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf"] Jul 09 14:08:57.633981 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:08:57.633958 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8629163e_4557_4ff7_bbe1_12276f74a2b7.slice/crio-ca31723629843aef7f9616be69fc878d7fdf6514c62dd6ddcc730bc5a94a35d1 WatchSource:0}: Error finding container ca31723629843aef7f9616be69fc878d7fdf6514c62dd6ddcc730bc5a94a35d1: Status 404 returned error can't find the container with id ca31723629843aef7f9616be69fc878d7fdf6514c62dd6ddcc730bc5a94a35d1 Jul 09 14:08:58.229814 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:08:58.229778 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" event={"ID":"8629163e-4557-4ff7-bbe1-12276f74a2b7","Type":"ContainerStarted","Data":"ca31723629843aef7f9616be69fc878d7fdf6514c62dd6ddcc730bc5a94a35d1"} Jul 09 14:09:00.238627 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:00.238589 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" event={"ID":"8629163e-4557-4ff7-bbe1-12276f74a2b7","Type":"ContainerStarted","Data":"8dd7a363213e092c81918123ddb449dfa5a964131e1426e9a5a7e812ef4588d6"} Jul 09 14:09:00.239117 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:00.238730 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:09:00.257434 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:00.257384 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" podStartSLOduration=1.664337265 podStartE2EDuration="3.257367973s" totalImagesPullingTime="1.593030708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:08:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:00.255722051 +0000 UTC m=+373.072132323" watchObservedRunningTime="2026-07-09 14:09:00.257367973 +0000 UTC m=+373.073778244" Jul 09 14:09:05.991637 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:05.991603 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl"] Jul 09 14:09:05.997640 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:05.997622 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.003471 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.003447 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 14:09:06.003832 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.003676 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qwmbp\"" Jul 09 14:09:06.004373 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.004354 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 14:09:06.004619 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.004603 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 14:09:06.005175 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.005160 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 14:09:06.026783 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.026761 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl"] Jul 09 14:09:06.054175 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.054145 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/416c8b0c-1a8a-49ab-9a8d-9500b6480304-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.054301 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.054180 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sk6b6\" (UniqueName: \"kubernetes.io/projected/416c8b0c-1a8a-49ab-9a8d-9500b6480304-kube-api-access-sk6b6\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.054301 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.054250 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/416c8b0c-1a8a-49ab-9a8d-9500b6480304-manifests\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.054390 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.054306 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416c8b0c-1a8a-49ab-9a8d-9500b6480304-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.054390 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.054337 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/416c8b0c-1a8a-49ab-9a8d-9500b6480304-tmp\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.154984 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.154948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/416c8b0c-1a8a-49ab-9a8d-9500b6480304-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.154984 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.154982 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sk6b6\" (UniqueName: \"kubernetes.io/projected/416c8b0c-1a8a-49ab-9a8d-9500b6480304-kube-api-access-sk6b6\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.155230 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.155062 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/416c8b0c-1a8a-49ab-9a8d-9500b6480304-manifests\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.155230 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.155094 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416c8b0c-1a8a-49ab-9a8d-9500b6480304-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.155230 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.155120 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/416c8b0c-1a8a-49ab-9a8d-9500b6480304-tmp\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.155511 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.155486 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/416c8b0c-1a8a-49ab-9a8d-9500b6480304-manifests\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.157495 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.157462 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/416c8b0c-1a8a-49ab-9a8d-9500b6480304-tmp\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.157608 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.157526 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/416c8b0c-1a8a-49ab-9a8d-9500b6480304-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.157652 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.157624 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/416c8b0c-1a8a-49ab-9a8d-9500b6480304-webhook-cert\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.164799 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.164772 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sk6b6\" (UniqueName: \"kubernetes.io/projected/416c8b0c-1a8a-49ab-9a8d-9500b6480304-kube-api-access-sk6b6\") pod \"opendatahub-operator-controller-manager-6f67568454-cjqpl\" (UID: \"416c8b0c-1a8a-49ab-9a8d-9500b6480304\") " pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.307897 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.307814 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:06.443459 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:06.443434 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl"] Jul 09 14:09:06.446285 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:09:06.446259 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod416c8b0c_1a8a_49ab_9a8d_9500b6480304.slice/crio-e89cb0a44af4260a43d6ed0bca955babdf3ef00cdb425f594977960fe20f54d6 WatchSource:0}: Error finding container e89cb0a44af4260a43d6ed0bca955babdf3ef00cdb425f594977960fe20f54d6: Status 404 returned error can't find the container with id e89cb0a44af4260a43d6ed0bca955babdf3ef00cdb425f594977960fe20f54d6 Jul 09 14:09:07.267556 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:07.267514 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" event={"ID":"416c8b0c-1a8a-49ab-9a8d-9500b6480304","Type":"ContainerStarted","Data":"e89cb0a44af4260a43d6ed0bca955babdf3ef00cdb425f594977960fe20f54d6"} Jul 09 14:09:11.245441 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:11.245405 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-677b74f79f-cmwqf" Jul 09 14:09:12.290902 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:12.290865 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" event={"ID":"416c8b0c-1a8a-49ab-9a8d-9500b6480304","Type":"ContainerStarted","Data":"6574999a157e227cc8f44f7fb33bb3bfd2abcc79e13a217c75e30cbe706b4bca"} Jul 09 14:09:13.297046 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:13.296995 2556 generic.go:356] "Generic (PLEG): container finished" podID="416c8b0c-1a8a-49ab-9a8d-9500b6480304" containerID="6574999a157e227cc8f44f7fb33bb3bfd2abcc79e13a217c75e30cbe706b4bca" exitCode=0 Jul 09 14:09:13.297509 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:13.297083 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" event={"ID":"416c8b0c-1a8a-49ab-9a8d-9500b6480304","Type":"ContainerDied","Data":"6574999a157e227cc8f44f7fb33bb3bfd2abcc79e13a217c75e30cbe706b4bca"} Jul 09 14:09:14.302638 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:14.302597 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" event={"ID":"416c8b0c-1a8a-49ab-9a8d-9500b6480304","Type":"ContainerStarted","Data":"55d25483ad4ebecb155fb2fb58aae612e3e46970eb669bbb02aa2536fbdeb0e2"} Jul 09 14:09:14.303066 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:14.302736 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:14.324681 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:14.323762 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" podStartSLOduration=2.571863881 podStartE2EDuration="9.323746609s" totalImagesPullingTime="5.739334576s" totalInitContainerRuntime="1.012548152s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:14.32253074 +0000 UTC m=+387.138941011" watchObservedRunningTime="2026-07-09 14:09:14.323746609 +0000 UTC m=+387.140156880" Jul 09 14:09:25.308922 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:25.308891 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6f67568454-cjqpl" Jul 09 14:09:27.536927 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.536890 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb"] Jul 09 14:09:27.545597 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.545579 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.548758 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.548738 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 14:09:27.549134 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.549120 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 14:09:27.549777 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.549762 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-pvbcl\"" Jul 09 14:09:27.549817 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.549800 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 14:09:27.549854 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.549770 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 14:09:27.561250 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.561224 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb"] Jul 09 14:09:27.637319 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.637289 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsbnz\" (UniqueName: \"kubernetes.io/projected/66865c31-3d46-497b-87c4-7413e0611974-kube-api-access-gsbnz\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.637466 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.637399 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66865c31-3d46-497b-87c4-7413e0611974-tls-certs\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.637466 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.637438 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66865c31-3d46-497b-87c4-7413e0611974-tmp\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.738585 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.738557 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66865c31-3d46-497b-87c4-7413e0611974-tls-certs\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.738756 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.738592 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66865c31-3d46-497b-87c4-7413e0611974-tmp\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.738756 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.738630 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsbnz\" (UniqueName: \"kubernetes.io/projected/66865c31-3d46-497b-87c4-7413e0611974-kube-api-access-gsbnz\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.740882 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.740855 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66865c31-3d46-497b-87c4-7413e0611974-tmp\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.741121 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.741102 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66865c31-3d46-497b-87c4-7413e0611974-tls-certs\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.751510 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.751484 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsbnz\" (UniqueName: \"kubernetes.io/projected/66865c31-3d46-497b-87c4-7413e0611974-kube-api-access-gsbnz\") pod \"kube-auth-proxy-79b6dccbd4-v98zb\" (UID: \"66865c31-3d46-497b-87c4-7413e0611974\") " pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.855837 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.855755 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" Jul 09 14:09:27.992643 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:27.992617 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb"] Jul 09 14:09:27.993993 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:09:27.993964 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66865c31_3d46_497b_87c4_7413e0611974.slice/crio-93dd5acf621a4d0d0866dda3baabc04d6f160fb333ea381d477d4b5d085c4e35 WatchSource:0}: Error finding container 93dd5acf621a4d0d0866dda3baabc04d6f160fb333ea381d477d4b5d085c4e35: Status 404 returned error can't find the container with id 93dd5acf621a4d0d0866dda3baabc04d6f160fb333ea381d477d4b5d085c4e35 Jul 09 14:09:28.368326 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:28.368288 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" event={"ID":"66865c31-3d46-497b-87c4-7413e0611974","Type":"ContainerStarted","Data":"93dd5acf621a4d0d0866dda3baabc04d6f160fb333ea381d477d4b5d085c4e35"} Jul 09 14:09:32.388078 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:32.388040 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" event={"ID":"66865c31-3d46-497b-87c4-7413e0611974","Type":"ContainerStarted","Data":"4b257fc9879f672a6cfb4401e9da18f55ede1cbab0bbce4b8e2dccd92ac738e4"} Jul 09 14:09:32.404590 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:09:32.404497 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79b6dccbd4-v98zb" podStartSLOduration=1.6595390810000001 podStartE2EDuration="5.404480138s" totalImagesPullingTime="3.744941057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:09:32.403442299 +0000 UTC m=+405.219852571" watchObservedRunningTime="2026-07-09 14:09:32.404480138 +0000 UTC m=+405.220890412" Jul 09 14:11:38.814992 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.814957 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf"] Jul 09 14:11:38.818258 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.818238 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:38.821022 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.820985 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:11:38.821135 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.821026 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-48vw8\"" Jul 09 14:11:38.821356 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.821340 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:11:38.831094 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.831074 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf"] Jul 09 14:11:38.917637 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.917606 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:38.917786 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:38.917643 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv976\" (UniqueName: \"kubernetes.io/projected/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-kube-api-access-nv976\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:39.018678 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.018602 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:39.018678 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.018640 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv976\" (UniqueName: \"kubernetes.io/projected/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-kube-api-access-nv976\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:39.019029 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.018987 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:39.032480 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.032452 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv976\" (UniqueName: \"kubernetes.io/projected/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-kube-api-access-nv976\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:39.127602 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.127526 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:39.257767 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.257736 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf"] Jul 09 14:11:39.260946 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:11:39.260920 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef009cf_6f7e_47b5_87f7_f4ee14757ced.slice/crio-1c9c467b363b6c74b00dbe984c38b815e324011464da3cd31c282b763920edfe WatchSource:0}: Error finding container 1c9c467b363b6c74b00dbe984c38b815e324011464da3cd31c282b763920edfe: Status 404 returned error can't find the container with id 1c9c467b363b6c74b00dbe984c38b815e324011464da3cd31c282b763920edfe Jul 09 14:11:39.502215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.502180 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf"] Jul 09 14:11:39.507038 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.506990 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf"] Jul 09 14:11:39.543427 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.543400 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz"] Jul 09 14:11:39.547648 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.547631 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.563606 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.563578 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz"] Jul 09 14:11:39.725630 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.725599 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2jtx\" (UniqueName: \"kubernetes.io/projected/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-kube-api-access-v2jtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2v8cz\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.725783 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.725679 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2v8cz\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.826878 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.826813 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2v8cz\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.826878 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.826868 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2jtx\" (UniqueName: \"kubernetes.io/projected/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-kube-api-access-v2jtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2v8cz\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.827288 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.827164 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2v8cz\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.837573 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.837516 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2jtx\" (UniqueName: \"kubernetes.io/projected/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-kube-api-access-v2jtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2v8cz\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:39.859270 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:39.859214 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:40.193885 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:40.193811 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz"] Jul 09 14:11:40.232169 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:11:40.232138 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55a5bcd3_bfab_4c6b_9e58_9d1a69e599a0.slice/crio-e0f03f707318902f040231b8dc83e4f46ac4d56824a9f5f7ffdf3e88a277502c WatchSource:0}: Error finding container e0f03f707318902f040231b8dc83e4f46ac4d56824a9f5f7ffdf3e88a277502c: Status 404 returned error can't find the container with id e0f03f707318902f040231b8dc83e4f46ac4d56824a9f5f7ffdf3e88a277502c Jul 09 14:11:40.908747 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:40.908713 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" event={"ID":"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0","Type":"ContainerStarted","Data":"e0f03f707318902f040231b8dc83e4f46ac4d56824a9f5f7ffdf3e88a277502c"} Jul 09 14:11:44.929510 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:44.929407 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" event={"ID":"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0","Type":"ContainerStarted","Data":"2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a"} Jul 09 14:11:44.929510 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:44.929480 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:44.931118 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:44.931071 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" containerName="manager" containerID="cri-o://d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd" gracePeriod=2 Jul 09 14:11:44.952498 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:44.952456 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" podStartSLOduration=1.506751692 podStartE2EDuration="5.952440051s" totalImagesPullingTime="4.445688359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:11:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:11:44.950650389 +0000 UTC m=+537.767060660" watchObservedRunningTime="2026-07-09 14:11:44.952440051 +0000 UTC m=+537.768850321" Jul 09 14:11:45.166952 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.166928 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:45.169061 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:11:45.169034 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" is forbidden: User \"system:node:ip-10-0-134-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-157.ec2.internal' and this object" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:45.276373 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.276338 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nv976\" (UniqueName: \"kubernetes.io/projected/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-kube-api-access-nv976\") pod \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " Jul 09 14:11:45.276561 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.276400 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-extensions-socket-volume\") pod \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\" (UID: \"8ef009cf-6f7e-47b5-87f7-f4ee14757ced\") " Jul 09 14:11:45.276724 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.276698 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8ef009cf-6f7e-47b5-87f7-f4ee14757ced" (UID: "8ef009cf-6f7e-47b5-87f7-f4ee14757ced"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:11:45.278483 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.278461 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-kube-api-access-nv976" (OuterVolumeSpecName: "kube-api-access-nv976") pod "8ef009cf-6f7e-47b5-87f7-f4ee14757ced" (UID: "8ef009cf-6f7e-47b5-87f7-f4ee14757ced"). InnerVolumeSpecName "kube-api-access-nv976". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:11:45.377374 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.377343 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nv976\" (UniqueName: \"kubernetes.io/projected/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-kube-api-access-nv976\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:11:45.377374 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.377371 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8ef009cf-6f7e-47b5-87f7-f4ee14757ced-extensions-socket-volume\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:11:45.756799 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.756763 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" path="/var/lib/kubelet/pods/8ef009cf-6f7e-47b5-87f7-f4ee14757ced/volumes" Jul 09 14:11:45.936335 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.936298 2556 generic.go:356] "Generic (PLEG): container finished" podID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" containerID="d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd" exitCode=2 Jul 09 14:11:45.936788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.936348 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:45.936788 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.936391 2556 scope.go:117] "RemoveContainer" containerID="d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd" Jul 09 14:11:45.940682 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:11:45.940648 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" is forbidden: User \"system:node:ip-10-0-134-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-157.ec2.internal' and this object" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:45.944354 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.944338 2556 scope.go:117] "RemoveContainer" containerID="d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd" Jul 09 14:11:45.944624 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:11:45.944607 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd\": container with ID starting with d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd not found: ID does not exist" containerID="d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd" Jul 09 14:11:45.944670 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:45.944633 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd"} err="failed to get container status \"d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd\": rpc error: code = NotFound desc = could not find container \"d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd\": container with ID starting with d3c6952b8e7243ff03b6b7663971f8a73d6b666a822b0a7ded81e3ab114afdfd not found: ID does not exist" Jul 09 14:11:47.755095 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:11:47.755054 2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-j2sxf\" is forbidden: User \"system:node:ip-10-0-134-157.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-157.ec2.internal' and this object" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-j2sxf" Jul 09 14:11:51.920769 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:51.920737 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz"] Jul 09 14:11:51.921220 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:51.920895 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" podUID="55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" containerName="manager" containerID="cri-o://2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a" gracePeriod=10 Jul 09 14:11:51.922747 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:51.922720 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:52.149517 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.149489 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb"] Jul 09 14:11:52.149884 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.149866 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" containerName="manager" Jul 09 14:11:52.149998 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.149887 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" containerName="manager" Jul 09 14:11:52.149998 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.149963 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ef009cf-6f7e-47b5-87f7-f4ee14757ced" containerName="manager" Jul 09 14:11:52.152978 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.152950 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.165865 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.165839 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:52.166254 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.166231 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb"] Jul 09 14:11:52.237242 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.237215 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v2jtx\" (UniqueName: \"kubernetes.io/projected/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-kube-api-access-v2jtx\") pod \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " Jul 09 14:11:52.237369 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.237263 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-extensions-socket-volume\") pod \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\" (UID: \"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0\") " Jul 09 14:11:52.237418 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.237378 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k75dw\" (UniqueName: \"kubernetes.io/projected/28aa04b4-6a88-4781-84db-10b945917346-kube-api-access-k75dw\") pod \"kuadrant-operator-controller-manager-86878c769f-v5dsb\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.237471 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.237457 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aa04b4-6a88-4781-84db-10b945917346-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5dsb\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.237645 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.237619 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" (UID: "55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:11:52.239289 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.239267 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-kube-api-access-v2jtx" (OuterVolumeSpecName: "kube-api-access-v2jtx") pod "55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" (UID: "55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0"). InnerVolumeSpecName "kube-api-access-v2jtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:11:52.338168 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.338136 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aa04b4-6a88-4781-84db-10b945917346-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5dsb\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.338287 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.338179 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k75dw\" (UniqueName: \"kubernetes.io/projected/28aa04b4-6a88-4781-84db-10b945917346-kube-api-access-k75dw\") pod \"kuadrant-operator-controller-manager-86878c769f-v5dsb\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.338287 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.338251 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2jtx\" (UniqueName: \"kubernetes.io/projected/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-kube-api-access-v2jtx\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:11:52.338287 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.338268 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0-extensions-socket-volume\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:11:52.338493 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.338476 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aa04b4-6a88-4781-84db-10b945917346-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-v5dsb\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.347544 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.347508 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k75dw\" (UniqueName: \"kubernetes.io/projected/28aa04b4-6a88-4781-84db-10b945917346-kube-api-access-k75dw\") pod \"kuadrant-operator-controller-manager-86878c769f-v5dsb\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.472662 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.472633 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.612431 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.612334 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb"] Jul 09 14:11:52.615265 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:11:52.615238 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28aa04b4_6a88_4781_84db_10b945917346.slice/crio-0dddfb1ad14ea6ffc61ef9f95cd19d81c40d05dea3897644201a12e3dfac73e3 WatchSource:0}: Error finding container 0dddfb1ad14ea6ffc61ef9f95cd19d81c40d05dea3897644201a12e3dfac73e3: Status 404 returned error can't find the container with id 0dddfb1ad14ea6ffc61ef9f95cd19d81c40d05dea3897644201a12e3dfac73e3 Jul 09 14:11:52.967635 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.967602 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" event={"ID":"28aa04b4-6a88-4781-84db-10b945917346","Type":"ContainerStarted","Data":"916eba70fd94991a0b8936c7d242bad66449de96f436c2f7cb9019666c9050fe"} Jul 09 14:11:52.968052 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.967657 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" event={"ID":"28aa04b4-6a88-4781-84db-10b945917346","Type":"ContainerStarted","Data":"0dddfb1ad14ea6ffc61ef9f95cd19d81c40d05dea3897644201a12e3dfac73e3"} Jul 09 14:11:52.968052 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.967720 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:11:52.968932 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.968910 2556 generic.go:356] "Generic (PLEG): container finished" podID="55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" containerID="2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a" exitCode=0 Jul 09 14:11:52.969049 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.968941 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" Jul 09 14:11:52.969049 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.968962 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" event={"ID":"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0","Type":"ContainerDied","Data":"2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a"} Jul 09 14:11:52.969049 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.969039 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz" event={"ID":"55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0","Type":"ContainerDied","Data":"e0f03f707318902f040231b8dc83e4f46ac4d56824a9f5f7ffdf3e88a277502c"} Jul 09 14:11:52.969209 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.969072 2556 scope.go:117] "RemoveContainer" containerID="2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a" Jul 09 14:11:52.977516 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.977499 2556 scope.go:117] "RemoveContainer" containerID="2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a" Jul 09 14:11:52.977757 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:11:52.977736 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a\": container with ID starting with 2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a not found: ID does not exist" containerID="2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a" Jul 09 14:11:52.977806 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.977764 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a"} err="failed to get container status \"2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a\": rpc error: code = NotFound desc = could not find container \"2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a\": container with ID starting with 2729714cfdc6d043a12df737ae0be501df811181f5d305ea668a976570be632a not found: ID does not exist" Jul 09 14:11:52.988917 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:52.988878 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" podStartSLOduration=0.988864941 podStartE2EDuration="988.864941ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:11:52.987673579 +0000 UTC m=+545.804083842" watchObservedRunningTime="2026-07-09 14:11:52.988864941 +0000 UTC m=+545.805275216" Jul 09 14:11:53.006331 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:53.003851 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz"] Jul 09 14:11:53.011682 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:53.011661 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2v8cz"] Jul 09 14:11:53.754683 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:11:53.754652 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" path="/var/lib/kubelet/pods/55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0/volumes" Jul 09 14:12:03.976292 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:03.976255 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:12:25.641874 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.641840 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5llkx"] Jul 09 14:12:25.642273 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.642173 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" containerName="manager" Jul 09 14:12:25.642273 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.642184 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" containerName="manager" Jul 09 14:12:25.642273 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.642241 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="55a5bcd3-bfab-4c6b-9e58-9d1a69e599a0" containerName="manager" Jul 09 14:12:25.644139 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.644122 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:25.646478 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.646456 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xm6t4\"" Jul 09 14:12:25.653577 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.653557 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5llkx"] Jul 09 14:12:25.828919 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.828892 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznvg\" (UniqueName: \"kubernetes.io/projected/48e70bfc-36b1-4c8e-abcb-b5de600b494f-kube-api-access-rznvg\") pod \"authorino-58cd955675-5llkx\" (UID: \"48e70bfc-36b1-4c8e-abcb-b5de600b494f\") " pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:25.929599 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.929522 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznvg\" (UniqueName: \"kubernetes.io/projected/48e70bfc-36b1-4c8e-abcb-b5de600b494f-kube-api-access-rznvg\") pod \"authorino-58cd955675-5llkx\" (UID: \"48e70bfc-36b1-4c8e-abcb-b5de600b494f\") " pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:25.936752 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.936729 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznvg\" (UniqueName: \"kubernetes.io/projected/48e70bfc-36b1-4c8e-abcb-b5de600b494f-kube-api-access-rznvg\") pod \"authorino-58cd955675-5llkx\" (UID: \"48e70bfc-36b1-4c8e-abcb-b5de600b494f\") " pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:25.953170 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:25.953147 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:26.075857 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:26.075832 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5llkx"] Jul 09 14:12:26.078179 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:12:26.078153 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod48e70bfc_36b1_4c8e_abcb_b5de600b494f.slice/crio-a9b390b58669f8af86103f0a89727f3b8c6fc0dd7d87ee6e35f543a915875368 WatchSource:0}: Error finding container a9b390b58669f8af86103f0a89727f3b8c6fc0dd7d87ee6e35f543a915875368: Status 404 returned error can't find the container with id a9b390b58669f8af86103f0a89727f3b8c6fc0dd7d87ee6e35f543a915875368 Jul 09 14:12:26.112153 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:26.112120 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5llkx" event={"ID":"48e70bfc-36b1-4c8e-abcb-b5de600b494f","Type":"ContainerStarted","Data":"a9b390b58669f8af86103f0a89727f3b8c6fc0dd7d87ee6e35f543a915875368"} Jul 09 14:12:30.133867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:30.133831 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5llkx" event={"ID":"48e70bfc-36b1-4c8e-abcb-b5de600b494f","Type":"ContainerStarted","Data":"fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526"} Jul 09 14:12:30.149014 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:30.148959 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5llkx" podStartSLOduration=1.834743934 podStartE2EDuration="5.148942807s" totalImagesPullingTime="3.314198873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:12:30.148153055 +0000 UTC m=+582.964563326" watchObservedRunningTime="2026-07-09 14:12:30.148942807 +0000 UTC m=+582.965353078" Jul 09 14:12:31.244187 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:31.244154 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5llkx"] Jul 09 14:12:32.141872 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:32.141838 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5llkx" podUID="48e70bfc-36b1-4c8e-abcb-b5de600b494f" containerName="authorino" containerID="cri-o://fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526" gracePeriod=30 Jul 09 14:12:32.381214 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:32.381192 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:32.485464 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:32.485434 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rznvg\" (UniqueName: \"kubernetes.io/projected/48e70bfc-36b1-4c8e-abcb-b5de600b494f-kube-api-access-rznvg\") pod \"48e70bfc-36b1-4c8e-abcb-b5de600b494f\" (UID: \"48e70bfc-36b1-4c8e-abcb-b5de600b494f\") " Jul 09 14:12:32.487387 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:32.487360 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/48e70bfc-36b1-4c8e-abcb-b5de600b494f-kube-api-access-rznvg" (OuterVolumeSpecName: "kube-api-access-rznvg") pod "48e70bfc-36b1-4c8e-abcb-b5de600b494f" (UID: "48e70bfc-36b1-4c8e-abcb-b5de600b494f"). InnerVolumeSpecName "kube-api-access-rznvg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:12:32.586993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:32.586965 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rznvg\" (UniqueName: \"kubernetes.io/projected/48e70bfc-36b1-4c8e-abcb-b5de600b494f-kube-api-access-rznvg\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:12:33.146813 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.146782 2556 generic.go:356] "Generic (PLEG): container finished" podID="48e70bfc-36b1-4c8e-abcb-b5de600b494f" containerID="fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526" exitCode=0 Jul 09 14:12:33.146982 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.146821 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5llkx" Jul 09 14:12:33.146982 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.146868 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5llkx" event={"ID":"48e70bfc-36b1-4c8e-abcb-b5de600b494f","Type":"ContainerDied","Data":"fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526"} Jul 09 14:12:33.146982 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.146904 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5llkx" event={"ID":"48e70bfc-36b1-4c8e-abcb-b5de600b494f","Type":"ContainerDied","Data":"a9b390b58669f8af86103f0a89727f3b8c6fc0dd7d87ee6e35f543a915875368"} Jul 09 14:12:33.146982 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.146923 2556 scope.go:117] "RemoveContainer" containerID="fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526" Jul 09 14:12:33.155972 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.155956 2556 scope.go:117] "RemoveContainer" containerID="fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526" Jul 09 14:12:33.156253 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:12:33.156232 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526\": container with ID starting with fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526 not found: ID does not exist" containerID="fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526" Jul 09 14:12:33.156317 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.156266 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526"} err="failed to get container status \"fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526\": rpc error: code = NotFound desc = could not find container \"fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526\": container with ID starting with fba2998eb82cb70dd17a0ad1385157097ef7eff7abe744cb07db26d62ffa5526 not found: ID does not exist" Jul 09 14:12:33.167002 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.166980 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5llkx"] Jul 09 14:12:33.172548 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.172529 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5llkx"] Jul 09 14:12:33.755881 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:33.755852 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="48e70bfc-36b1-4c8e-abcb-b5de600b494f" path="/var/lib/kubelet/pods/48e70bfc-36b1-4c8e-abcb-b5de600b494f/volumes" Jul 09 14:12:47.609520 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:47.609490 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:12:47.610487 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:47.610465 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:12:57.910215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.910180 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrptq"] Jul 09 14:12:57.910681 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.910627 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="48e70bfc-36b1-4c8e-abcb-b5de600b494f" containerName="authorino" Jul 09 14:12:57.910681 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.910645 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="48e70bfc-36b1-4c8e-abcb-b5de600b494f" containerName="authorino" Jul 09 14:12:57.910793 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.910719 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="48e70bfc-36b1-4c8e-abcb-b5de600b494f" containerName="authorino" Jul 09 14:12:57.913527 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.913506 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:12:57.915950 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.915925 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-xm6t4\"" Jul 09 14:12:57.918868 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.918845 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrptq"] Jul 09 14:12:57.996912 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:57.996884 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ld59d\" (UniqueName: \"kubernetes.io/projected/5c0f6031-0513-4224-894e-5229c99cbb7a-kube-api-access-ld59d\") pod \"authorino-5d4b67c446-jrptq\" (UID: \"5c0f6031-0513-4224-894e-5229c99cbb7a\") " pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:12:58.097521 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.097486 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ld59d\" (UniqueName: \"kubernetes.io/projected/5c0f6031-0513-4224-894e-5229c99cbb7a-kube-api-access-ld59d\") pod \"authorino-5d4b67c446-jrptq\" (UID: \"5c0f6031-0513-4224-894e-5229c99cbb7a\") " pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:12:58.106374 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.106341 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ld59d\" (UniqueName: \"kubernetes.io/projected/5c0f6031-0513-4224-894e-5229c99cbb7a-kube-api-access-ld59d\") pod \"authorino-5d4b67c446-jrptq\" (UID: \"5c0f6031-0513-4224-894e-5229c99cbb7a\") " pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:12:58.133301 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.133278 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrptq"] Jul 09 14:12:58.133512 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.133498 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:12:58.159279 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.159255 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-86bb784ccb-kzxpk"] Jul 09 14:12:58.161810 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.161746 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:12:58.172543 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.172493 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-86bb784ccb-kzxpk"] Jul 09 14:12:58.263076 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.263048 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrptq"] Jul 09 14:12:58.265469 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:12:58.265442 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c0f6031_0513_4224_894e_5229c99cbb7a.slice/crio-179392d13ec4efb6ac5d1baa579cf8ea3ca8b2b44ba9d784a5bf72926cfbfb73 WatchSource:0}: Error finding container 179392d13ec4efb6ac5d1baa579cf8ea3ca8b2b44ba9d784a5bf72926cfbfb73: Status 404 returned error can't find the container with id 179392d13ec4efb6ac5d1baa579cf8ea3ca8b2b44ba9d784a5bf72926cfbfb73 Jul 09 14:12:58.293828 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.293800 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86bb784ccb-kzxpk"] Jul 09 14:12:58.294061 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:12:58.294041 2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-998n2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-86bb784ccb-kzxpk" podUID="c4a6acb5-bfcb-436a-bfa0-78d0c3774223" Jul 09 14:12:58.299559 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.299533 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-998n2\" (UniqueName: \"kubernetes.io/projected/c4a6acb5-bfcb-436a-bfa0-78d0c3774223-kube-api-access-998n2\") pod \"authorino-86bb784ccb-kzxpk\" (UID: \"c4a6acb5-bfcb-436a-bfa0-78d0c3774223\") " pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:12:58.321951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.321929 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-768cdb65cb-2kb66"] Jul 09 14:12:58.324215 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.324200 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.326327 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.326308 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 09 14:12:58.333925 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.333905 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768cdb65cb-2kb66"] Jul 09 14:12:58.400033 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.399975 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/525bc54a-882d-4b23-8d08-a24482243548-tls-cert\") pod \"authorino-768cdb65cb-2kb66\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.400221 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.400067 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-998n2\" (UniqueName: \"kubernetes.io/projected/c4a6acb5-bfcb-436a-bfa0-78d0c3774223-kube-api-access-998n2\") pod \"authorino-86bb784ccb-kzxpk\" (UID: \"c4a6acb5-bfcb-436a-bfa0-78d0c3774223\") " pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:12:58.400221 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.400114 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qff8\" (UniqueName: \"kubernetes.io/projected/525bc54a-882d-4b23-8d08-a24482243548-kube-api-access-8qff8\") pod \"authorino-768cdb65cb-2kb66\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.408088 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.408059 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-998n2\" (UniqueName: \"kubernetes.io/projected/c4a6acb5-bfcb-436a-bfa0-78d0c3774223-kube-api-access-998n2\") pod \"authorino-86bb784ccb-kzxpk\" (UID: \"c4a6acb5-bfcb-436a-bfa0-78d0c3774223\") " pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:12:58.501176 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.501144 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qff8\" (UniqueName: \"kubernetes.io/projected/525bc54a-882d-4b23-8d08-a24482243548-kube-api-access-8qff8\") pod \"authorino-768cdb65cb-2kb66\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.501443 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.501213 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/525bc54a-882d-4b23-8d08-a24482243548-tls-cert\") pod \"authorino-768cdb65cb-2kb66\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.503633 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.503608 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/525bc54a-882d-4b23-8d08-a24482243548-tls-cert\") pod \"authorino-768cdb65cb-2kb66\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.508688 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.508664 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qff8\" (UniqueName: \"kubernetes.io/projected/525bc54a-882d-4b23-8d08-a24482243548-kube-api-access-8qff8\") pod \"authorino-768cdb65cb-2kb66\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.633832 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.633792 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:12:58.756230 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:58.756040 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-768cdb65cb-2kb66"] Jul 09 14:12:58.758291 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:12:58.758272 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod525bc54a_882d_4b23_8d08_a24482243548.slice/crio-41ff933a0d19d548bf68c83a89f1762c20b1c66c4cc7e606894aba5d52774144 WatchSource:0}: Error finding container 41ff933a0d19d548bf68c83a89f1762c20b1c66c4cc7e606894aba5d52774144: Status 404 returned error can't find the container with id 41ff933a0d19d548bf68c83a89f1762c20b1c66c4cc7e606894aba5d52774144 Jul 09 14:12:59.262185 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.262150 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768cdb65cb-2kb66" event={"ID":"525bc54a-882d-4b23-8d08-a24482243548","Type":"ContainerStarted","Data":"6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f"} Jul 09 14:12:59.262185 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.262197 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768cdb65cb-2kb66" event={"ID":"525bc54a-882d-4b23-8d08-a24482243548","Type":"ContainerStarted","Data":"41ff933a0d19d548bf68c83a89f1762c20b1c66c4cc7e606894aba5d52774144"} Jul 09 14:12:59.263623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.263604 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:12:59.263623 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.263606 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrptq" event={"ID":"5c0f6031-0513-4224-894e-5229c99cbb7a","Type":"ContainerStarted","Data":"095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d"} Jul 09 14:12:59.263755 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.263645 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrptq" event={"ID":"5c0f6031-0513-4224-894e-5229c99cbb7a","Type":"ContainerStarted","Data":"179392d13ec4efb6ac5d1baa579cf8ea3ca8b2b44ba9d784a5bf72926cfbfb73"} Jul 09 14:12:59.263755 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.263651 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-jrptq" podUID="5c0f6031-0513-4224-894e-5229c99cbb7a" containerName="authorino" containerID="cri-o://095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d" gracePeriod=30 Jul 09 14:12:59.269695 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.269674 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:12:59.277880 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.277839 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-768cdb65cb-2kb66" podStartSLOduration=0.989928306 podStartE2EDuration="1.277826876s" totalImagesPullingTime="287.89857ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:12:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:12:59.277276545 +0000 UTC m=+612.093686814" watchObservedRunningTime="2026-07-09 14:12:59.277826876 +0000 UTC m=+612.094237124" Jul 09 14:12:59.292155 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.292072 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-jrptq" podStartSLOduration=1.519303851 podStartE2EDuration="2.292054195s" totalImagesPullingTime="772.750344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:12:59.29128167 +0000 UTC m=+612.107691942" watchObservedRunningTime="2026-07-09 14:12:59.292054195 +0000 UTC m=+612.108464468" Jul 09 14:12:59.408760 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.408721 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-998n2\" (UniqueName: \"kubernetes.io/projected/c4a6acb5-bfcb-436a-bfa0-78d0c3774223-kube-api-access-998n2\") pod \"c4a6acb5-bfcb-436a-bfa0-78d0c3774223\" (UID: \"c4a6acb5-bfcb-436a-bfa0-78d0c3774223\") " Jul 09 14:12:59.410718 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.410687 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4a6acb5-bfcb-436a-bfa0-78d0c3774223-kube-api-access-998n2" (OuterVolumeSpecName: "kube-api-access-998n2") pod "c4a6acb5-bfcb-436a-bfa0-78d0c3774223" (UID: "c4a6acb5-bfcb-436a-bfa0-78d0c3774223"). InnerVolumeSpecName "kube-api-access-998n2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:12:59.495162 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.495141 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:12:59.510405 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.510359 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-998n2\" (UniqueName: \"kubernetes.io/projected/c4a6acb5-bfcb-436a-bfa0-78d0c3774223-kube-api-access-998n2\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:12:59.610924 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.610849 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ld59d\" (UniqueName: \"kubernetes.io/projected/5c0f6031-0513-4224-894e-5229c99cbb7a-kube-api-access-ld59d\") pod \"5c0f6031-0513-4224-894e-5229c99cbb7a\" (UID: \"5c0f6031-0513-4224-894e-5229c99cbb7a\") " Jul 09 14:12:59.612867 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.612835 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c0f6031-0513-4224-894e-5229c99cbb7a-kube-api-access-ld59d" (OuterVolumeSpecName: "kube-api-access-ld59d") pod "5c0f6031-0513-4224-894e-5229c99cbb7a" (UID: "5c0f6031-0513-4224-894e-5229c99cbb7a"). InnerVolumeSpecName "kube-api-access-ld59d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:12:59.711851 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:12:59.711820 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ld59d\" (UniqueName: \"kubernetes.io/projected/5c0f6031-0513-4224-894e-5229c99cbb7a-kube-api-access-ld59d\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:13:00.268885 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.268844 2556 generic.go:356] "Generic (PLEG): container finished" podID="5c0f6031-0513-4224-894e-5229c99cbb7a" containerID="095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d" exitCode=0 Jul 09 14:13:00.268885 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.268881 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-jrptq" Jul 09 14:13:00.269365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.268922 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrptq" event={"ID":"5c0f6031-0513-4224-894e-5229c99cbb7a","Type":"ContainerDied","Data":"095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d"} Jul 09 14:13:00.269365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.268968 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-jrptq" event={"ID":"5c0f6031-0513-4224-894e-5229c99cbb7a","Type":"ContainerDied","Data":"179392d13ec4efb6ac5d1baa579cf8ea3ca8b2b44ba9d784a5bf72926cfbfb73"} Jul 09 14:13:00.269365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.268990 2556 scope.go:117] "RemoveContainer" containerID="095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d" Jul 09 14:13:00.269365 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.269057 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-86bb784ccb-kzxpk" Jul 09 14:13:00.277133 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.277123 2556 scope.go:117] "RemoveContainer" containerID="095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d" Jul 09 14:13:00.277399 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:13:00.277379 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d\": container with ID starting with 095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d not found: ID does not exist" containerID="095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d" Jul 09 14:13:00.277449 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.277408 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d"} err="failed to get container status \"095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d\": rpc error: code = NotFound desc = could not find container \"095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d\": container with ID starting with 095bc9e26896f12944114fa89c9a5ca20aff7542e9b6d69bfcc496294623029d not found: ID does not exist" Jul 09 14:13:00.285624 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.285603 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrptq"] Jul 09 14:13:00.287987 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.287968 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-jrptq"] Jul 09 14:13:00.309112 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.309075 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-86bb784ccb-kzxpk"] Jul 09 14:13:00.311801 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:00.311777 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-86bb784ccb-kzxpk"] Jul 09 14:13:01.755385 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:01.755354 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c0f6031-0513-4224-894e-5229c99cbb7a" path="/var/lib/kubelet/pods/5c0f6031-0513-4224-894e-5229c99cbb7a/volumes" Jul 09 14:13:01.755758 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:13:01.755655 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4a6acb5-bfcb-436a-bfa0-78d0c3774223" path="/var/lib/kubelet/pods/c4a6acb5-bfcb-436a-bfa0-78d0c3774223/volumes" Jul 09 14:14:07.330924 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.330891 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv"] Jul 09 14:14:07.331406 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.331277 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c0f6031-0513-4224-894e-5229c99cbb7a" containerName="authorino" Jul 09 14:14:07.331406 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.331301 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c0f6031-0513-4224-894e-5229c99cbb7a" containerName="authorino" Jul 09 14:14:07.331487 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.331406 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c0f6031-0513-4224-894e-5229c99cbb7a" containerName="authorino" Jul 09 14:14:07.334130 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.334110 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.337534 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.337492 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 14:14:07.337534 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.337504 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 09 14:14:07.337534 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.337520 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f6xmw\"" Jul 09 14:14:07.337757 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.337578 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 14:14:07.344999 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.344977 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv"] Jul 09 14:14:07.477898 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.477868 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.478083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.477939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ttb7\" (UniqueName: \"kubernetes.io/projected/f49b63c8-02ab-4fef-a0b9-997977534cd0-kube-api-access-7ttb7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.478083 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.477990 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.478160 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.478081 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.478160 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.478113 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.478160 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.478128 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f49b63c8-02ab-4fef-a0b9-997977534cd0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.578784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.578747 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ttb7\" (UniqueName: \"kubernetes.io/projected/f49b63c8-02ab-4fef-a0b9-997977534cd0-kube-api-access-7ttb7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.578784 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.578788 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.578844 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.578880 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579041 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.578902 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f49b63c8-02ab-4fef-a0b9-997977534cd0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579179 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.579037 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579376 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.579347 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579529 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.579388 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.579529 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.579412 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.581167 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.581111 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f49b63c8-02ab-4fef-a0b9-997977534cd0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.581275 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.581259 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f49b63c8-02ab-4fef-a0b9-997977534cd0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.587507 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.587478 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ttb7\" (UniqueName: \"kubernetes.io/projected/f49b63c8-02ab-4fef-a0b9-997977534cd0-kube-api-access-7ttb7\") pod \"e2e-distinct-simulated-kserve-59975d69f9-pqdzv\" (UID: \"f49b63c8-02ab-4fef-a0b9-997977534cd0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.644518 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.644492 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:07.769440 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.769415 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv"] Jul 09 14:14:07.771410 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:14:07.771381 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49b63c8_02ab_4fef_a0b9_997977534cd0.slice/crio-5d0e1b438cca6976c9c0a6c9ff286582896e219585646bd7f8e4ea37d0f9ab6d WatchSource:0}: Error finding container 5d0e1b438cca6976c9c0a6c9ff286582896e219585646bd7f8e4ea37d0f9ab6d: Status 404 returned error can't find the container with id 5d0e1b438cca6976c9c0a6c9ff286582896e219585646bd7f8e4ea37d0f9ab6d Jul 09 14:14:07.772722 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:07.772707 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:14:08.553936 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:08.553900 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" event={"ID":"f49b63c8-02ab-4fef-a0b9-997977534cd0","Type":"ContainerStarted","Data":"5d0e1b438cca6976c9c0a6c9ff286582896e219585646bd7f8e4ea37d0f9ab6d"} Jul 09 14:14:09.559807 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:09.559773 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" event={"ID":"f49b63c8-02ab-4fef-a0b9-997977534cd0","Type":"ContainerStarted","Data":"eb98f7584c2a20940083d9ee0388c6f95300a5351340b8a5e6a61c53ec108b63"} Jul 09 14:14:09.577952 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:09.577910 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" podStartSLOduration=1.467287975 podStartE2EDuration="2.577894501s" totalImagesPullingTime="1.110606526s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:14:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:14:09.577378509 +0000 UTC m=+682.393788781" watchObservedRunningTime="2026-07-09 14:14:09.577894501 +0000 UTC m=+682.394304764" Jul 09 14:14:17.645155 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:17.645122 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:17.645621 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:17.645176 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:17.657336 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:17.657311 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:18.608544 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:18.608516 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-pqdzv" Jul 09 14:14:29.524747 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.524717 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk"] Jul 09 14:14:29.526964 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.526946 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.529561 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.529542 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 09 14:14:29.538522 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.538503 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk"] Jul 09 14:14:29.553264 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.553243 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.553363 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.553279 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.553363 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.553312 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.553363 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.553329 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd77b\" (UniqueName: \"kubernetes.io/projected/ad0a75ef-2235-440f-92a1-5840fc0e1fba-kube-api-access-jd77b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.553363 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.553355 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad0a75ef-2235-440f-92a1-5840fc0e1fba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.553540 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.553369 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.653891 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.653863 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.653905 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.653921 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd77b\" (UniqueName: \"kubernetes.io/projected/ad0a75ef-2235-440f-92a1-5840fc0e1fba-kube-api-access-jd77b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.653956 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad0a75ef-2235-440f-92a1-5840fc0e1fba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.653979 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.654068 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654335 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.654309 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654372 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.654358 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.654408 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.654381 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.656285 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.656256 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad0a75ef-2235-440f-92a1-5840fc0e1fba-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.656438 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.656419 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad0a75ef-2235-440f-92a1-5840fc0e1fba-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.661188 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.661168 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd77b\" (UniqueName: \"kubernetes.io/projected/ad0a75ef-2235-440f-92a1-5840fc0e1fba-kube-api-access-jd77b\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk\" (UID: \"ad0a75ef-2235-440f-92a1-5840fc0e1fba\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.837092 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.836993 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:29.963976 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:29.963951 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk"] Jul 09 14:14:29.966486 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:14:29.966457 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0a75ef_2235_440f_92a1_5840fc0e1fba.slice/crio-df2519378ffeaad65bd251077db9b7af5862b84ad645f6cfbd14eb0edf2fb25b WatchSource:0}: Error finding container df2519378ffeaad65bd251077db9b7af5862b84ad645f6cfbd14eb0edf2fb25b: Status 404 returned error can't find the container with id df2519378ffeaad65bd251077db9b7af5862b84ad645f6cfbd14eb0edf2fb25b Jul 09 14:14:30.651355 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:30.651241 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" event={"ID":"ad0a75ef-2235-440f-92a1-5840fc0e1fba","Type":"ContainerStarted","Data":"3dae6fb9cc3a6a024b43795802d11ea189e7510a58abedd40c792d76055214ec"} Jul 09 14:14:30.651716 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:30.651398 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" event={"ID":"ad0a75ef-2235-440f-92a1-5840fc0e1fba","Type":"ContainerStarted","Data":"df2519378ffeaad65bd251077db9b7af5862b84ad645f6cfbd14eb0edf2fb25b"} Jul 09 14:14:30.670529 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:30.670444 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" podStartSLOduration=1.449845887 podStartE2EDuration="1.670426088s" totalImagesPullingTime="220.580201ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:14:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:14:30.669996408 +0000 UTC m=+703.486406681" watchObservedRunningTime="2026-07-09 14:14:30.670426088 +0000 UTC m=+703.486836360" Jul 09 14:14:39.837165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:39.837080 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:39.837165 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:39.837152 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:39.849729 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:39.849706 2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:14:40.708694 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:14:40.708665 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk" Jul 09 14:15:25.480120 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.480053 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768cdb65cb-2kb66"] Jul 09 14:15:25.480804 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.480369 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-768cdb65cb-2kb66" podUID="525bc54a-882d-4b23-8d08-a24482243548" containerName="authorino" containerID="cri-o://6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f" gracePeriod=30 Jul 09 14:15:25.721736 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.721710 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:15:25.840800 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.840721 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/525bc54a-882d-4b23-8d08-a24482243548-tls-cert\") pod \"525bc54a-882d-4b23-8d08-a24482243548\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " Jul 09 14:15:25.840800 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.840762 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8qff8\" (UniqueName: \"kubernetes.io/projected/525bc54a-882d-4b23-8d08-a24482243548-kube-api-access-8qff8\") pod \"525bc54a-882d-4b23-8d08-a24482243548\" (UID: \"525bc54a-882d-4b23-8d08-a24482243548\") " Jul 09 14:15:25.842716 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.842689 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/525bc54a-882d-4b23-8d08-a24482243548-kube-api-access-8qff8" (OuterVolumeSpecName: "kube-api-access-8qff8") pod "525bc54a-882d-4b23-8d08-a24482243548" (UID: "525bc54a-882d-4b23-8d08-a24482243548"). InnerVolumeSpecName "kube-api-access-8qff8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:15:25.849982 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.849951 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/525bc54a-882d-4b23-8d08-a24482243548-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "525bc54a-882d-4b23-8d08-a24482243548" (UID: "525bc54a-882d-4b23-8d08-a24482243548"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:15:25.884790 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.884761 2556 generic.go:356] "Generic (PLEG): container finished" podID="525bc54a-882d-4b23-8d08-a24482243548" containerID="6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f" exitCode=0 Jul 09 14:15:25.884925 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.884796 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768cdb65cb-2kb66" event={"ID":"525bc54a-882d-4b23-8d08-a24482243548","Type":"ContainerDied","Data":"6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f"} Jul 09 14:15:25.884925 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.884824 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-768cdb65cb-2kb66" event={"ID":"525bc54a-882d-4b23-8d08-a24482243548","Type":"ContainerDied","Data":"41ff933a0d19d548bf68c83a89f1762c20b1c66c4cc7e606894aba5d52774144"} Jul 09 14:15:25.884925 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.884798 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-768cdb65cb-2kb66" Jul 09 14:15:25.884925 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.884841 2556 scope.go:117] "RemoveContainer" containerID="6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f" Jul 09 14:15:25.893583 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.893559 2556 scope.go:117] "RemoveContainer" containerID="6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f" Jul 09 14:15:25.893834 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:15:25.893813 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f\": container with ID starting with 6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f not found: ID does not exist" containerID="6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f" Jul 09 14:15:25.893918 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.893841 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f"} err="failed to get container status \"6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f\": rpc error: code = NotFound desc = could not find container \"6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f\": container with ID starting with 6a673396f8d68d27d08658ace0e7ff32456b2738365d620b81c485ddd47ea66f not found: ID does not exist" Jul 09 14:15:25.905003 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.904982 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-768cdb65cb-2kb66"] Jul 09 14:15:25.908689 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.908665 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-768cdb65cb-2kb66"] Jul 09 14:15:25.941536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.941509 2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/525bc54a-882d-4b23-8d08-a24482243548-tls-cert\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:15:25.941536 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:25.941536 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8qff8\" (UniqueName: \"kubernetes.io/projected/525bc54a-882d-4b23-8d08-a24482243548-kube-api-access-8qff8\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:15:27.760885 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:15:27.760849 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="525bc54a-882d-4b23-8d08-a24482243548" path="/var/lib/kubelet/pods/525bc54a-882d-4b23-8d08-a24482243548/volumes" Jul 09 14:17:47.637911 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:17:47.637837 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:17:47.638539 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:17:47.638519 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:21:53.656356 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:53.656323 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb"] Jul 09 14:21:53.656931 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:53.656514 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" podUID="28aa04b4-6a88-4781-84db-10b945917346" containerName="manager" containerID="cri-o://916eba70fd94991a0b8936c7d242bad66449de96f436c2f7cb9019666c9050fe" gracePeriod=10 Jul 09 14:21:56.511918 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.511836 2556 generic.go:356] "Generic (PLEG): container finished" podID="28aa04b4-6a88-4781-84db-10b945917346" containerID="916eba70fd94991a0b8936c7d242bad66449de96f436c2f7cb9019666c9050fe" exitCode=0 Jul 09 14:21:56.511918 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.511898 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" event={"ID":"28aa04b4-6a88-4781-84db-10b945917346","Type":"ContainerDied","Data":"916eba70fd94991a0b8936c7d242bad66449de96f436c2f7cb9019666c9050fe"} Jul 09 14:21:56.902425 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.902398 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:21:56.989693 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.989660 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k75dw\" (UniqueName: \"kubernetes.io/projected/28aa04b4-6a88-4781-84db-10b945917346-kube-api-access-k75dw\") pod \"28aa04b4-6a88-4781-84db-10b945917346\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " Jul 09 14:21:56.989843 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.989701 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aa04b4-6a88-4781-84db-10b945917346-extensions-socket-volume\") pod \"28aa04b4-6a88-4781-84db-10b945917346\" (UID: \"28aa04b4-6a88-4781-84db-10b945917346\") " Jul 09 14:21:56.990114 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.990088 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28aa04b4-6a88-4781-84db-10b945917346-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "28aa04b4-6a88-4781-84db-10b945917346" (UID: "28aa04b4-6a88-4781-84db-10b945917346"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 14:21:56.991768 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:56.991747 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28aa04b4-6a88-4781-84db-10b945917346-kube-api-access-k75dw" (OuterVolumeSpecName: "kube-api-access-k75dw") pod "28aa04b4-6a88-4781-84db-10b945917346" (UID: "28aa04b4-6a88-4781-84db-10b945917346"). InnerVolumeSpecName "kube-api-access-k75dw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:21:57.090948 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.090868 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k75dw\" (UniqueName: \"kubernetes.io/projected/28aa04b4-6a88-4781-84db-10b945917346-kube-api-access-k75dw\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:21:57.090948 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.090896 2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/28aa04b4-6a88-4781-84db-10b945917346-extensions-socket-volume\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:21:57.517186 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.517157 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" event={"ID":"28aa04b4-6a88-4781-84db-10b945917346","Type":"ContainerDied","Data":"0dddfb1ad14ea6ffc61ef9f95cd19d81c40d05dea3897644201a12e3dfac73e3"} Jul 09 14:21:57.517186 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.517185 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb" Jul 09 14:21:57.517657 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.517217 2556 scope.go:117] "RemoveContainer" containerID="916eba70fd94991a0b8936c7d242bad66449de96f436c2f7cb9019666c9050fe" Jul 09 14:21:57.543963 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.543938 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb"] Jul 09 14:21:57.549101 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.549076 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-v5dsb"] Jul 09 14:21:57.760033 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:21:57.757819 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28aa04b4-6a88-4781-84db-10b945917346" path="/var/lib/kubelet/pods/28aa04b4-6a88-4781-84db-10b945917346/volumes" Jul 09 14:22:47.663551 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:47.663522 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:22:47.664896 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:47.664878 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:22:54.796355 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796324 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6"] Jul 09 14:22:54.796951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796788 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="525bc54a-882d-4b23-8d08-a24482243548" containerName="authorino" Jul 09 14:22:54.796951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796807 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="525bc54a-882d-4b23-8d08-a24482243548" containerName="authorino" Jul 09 14:22:54.796951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796822 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28aa04b4-6a88-4781-84db-10b945917346" containerName="manager" Jul 09 14:22:54.796951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796830 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28aa04b4-6a88-4781-84db-10b945917346" containerName="manager" Jul 09 14:22:54.796951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796906 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="28aa04b4-6a88-4781-84db-10b945917346" containerName="manager" Jul 09 14:22:54.796951 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.796917 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="525bc54a-882d-4b23-8d08-a24482243548" containerName="authorino" Jul 09 14:22:54.801072 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.801042 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:54.803736 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.803716 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 14:22:54.803836 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.803807 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-48vw8\"" Jul 09 14:22:54.803901 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.803842 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 14:22:54.811541 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.811518 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6"] Jul 09 14:22:54.879973 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.879939 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d93a8745-14fe-462f-b5ad-f44d35c8e3d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8qlc6\" (UID: \"d93a8745-14fe-462f-b5ad-f44d35c8e3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:54.880135 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.879998 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mt2h\" (UniqueName: \"kubernetes.io/projected/d93a8745-14fe-462f-b5ad-f44d35c8e3d8-kube-api-access-7mt2h\") pod \"kuadrant-operator-controller-manager-86878c769f-8qlc6\" (UID: \"d93a8745-14fe-462f-b5ad-f44d35c8e3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:54.980793 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.980749 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d93a8745-14fe-462f-b5ad-f44d35c8e3d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8qlc6\" (UID: \"d93a8745-14fe-462f-b5ad-f44d35c8e3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:54.980900 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.980823 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mt2h\" (UniqueName: \"kubernetes.io/projected/d93a8745-14fe-462f-b5ad-f44d35c8e3d8-kube-api-access-7mt2h\") pod \"kuadrant-operator-controller-manager-86878c769f-8qlc6\" (UID: \"d93a8745-14fe-462f-b5ad-f44d35c8e3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:54.981151 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.981134 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d93a8745-14fe-462f-b5ad-f44d35c8e3d8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8qlc6\" (UID: \"d93a8745-14fe-462f-b5ad-f44d35c8e3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:54.990703 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:54.990672 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mt2h\" (UniqueName: \"kubernetes.io/projected/d93a8745-14fe-462f-b5ad-f44d35c8e3d8-kube-api-access-7mt2h\") pod \"kuadrant-operator-controller-manager-86878c769f-8qlc6\" (UID: \"d93a8745-14fe-462f-b5ad-f44d35c8e3d8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:55.110790 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:55.110696 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:55.243417 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:55.243268 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6"] Jul 09 14:22:55.246458 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:22:55.246428 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd93a8745_14fe_462f_b5ad_f44d35c8e3d8.slice/crio-88aafa0ae5bf9c5c8181cdcf8f92e50988552500f8deda3260665c50ed6a76aa WatchSource:0}: Error finding container 88aafa0ae5bf9c5c8181cdcf8f92e50988552500f8deda3260665c50ed6a76aa: Status 404 returned error can't find the container with id 88aafa0ae5bf9c5c8181cdcf8f92e50988552500f8deda3260665c50ed6a76aa Jul 09 14:22:55.767639 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:55.767608 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" event={"ID":"d93a8745-14fe-462f-b5ad-f44d35c8e3d8","Type":"ContainerStarted","Data":"b26af63c033ba40333a3c00aa0fcbe2135323a11f14b35c74905d1fca1d00ad9"} Jul 09 14:22:55.767820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:55.767660 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" event={"ID":"d93a8745-14fe-462f-b5ad-f44d35c8e3d8","Type":"ContainerStarted","Data":"88aafa0ae5bf9c5c8181cdcf8f92e50988552500f8deda3260665c50ed6a76aa"} Jul 09 14:22:55.767820 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:55.767753 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:22:55.808938 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:22:55.808888 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" podStartSLOduration=1.808873597 podStartE2EDuration="1.808873597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:22:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:22:55.806042499 +0000 UTC m=+1208.622452767" watchObservedRunningTime="2026-07-09 14:22:55.808873597 +0000 UTC m=+1208.625283915" Jul 09 14:23:06.774791 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:23:06.774755 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8qlc6" Jul 09 14:27:47.686935 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:27:47.686903 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:27:47.689589 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:27:47.688783 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:28:47.783302 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.783268 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw"] Jul 09 14:28:47.786257 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.786241 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.788991 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.788965 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 14:28:47.789153 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.788965 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-61b35f5d-serving-cert\"" Jul 09 14:28:47.789815 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.789791 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 14:28:47.789815 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.789811 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-9nb6m\"" Jul 09 14:28:47.796992 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.796970 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw"] Jul 09 14:28:47.882413 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.882381 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn5lp\" (UniqueName: \"kubernetes.io/projected/6b3a4b56-ef2f-4354-88d8-21254b9ca510-kube-api-access-zn5lp\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.882589 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.882454 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3a4b56-ef2f-4354-88d8-21254b9ca510-openshift-service-ca\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.882589 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.882490 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b3a4b56-ef2f-4354-88d8-21254b9ca510-maas-api-tls\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.982971 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.982941 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3a4b56-ef2f-4354-88d8-21254b9ca510-openshift-service-ca\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.983154 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.982981 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b3a4b56-ef2f-4354-88d8-21254b9ca510-maas-api-tls\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.983154 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.983040 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn5lp\" (UniqueName: \"kubernetes.io/projected/6b3a4b56-ef2f-4354-88d8-21254b9ca510-kube-api-access-zn5lp\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.983687 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.983669 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3a4b56-ef2f-4354-88d8-21254b9ca510-openshift-service-ca\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.985673 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.985648 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b3a4b56-ef2f-4354-88d8-21254b9ca510-maas-api-tls\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:47.992201 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:47.992176 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn5lp\" (UniqueName: \"kubernetes.io/projected/6b3a4b56-ef2f-4354-88d8-21254b9ca510-kube-api-access-zn5lp\") pod \"maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:48.097691 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:48.097620 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:48.229146 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:48.229023 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw"] Jul 09 14:28:48.231487 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:28:48.231459 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b3a4b56_ef2f_4354_88d8_21254b9ca510.slice/crio-946d4ad9cfefc0b488608ceeff8174a025c014b80e9ea38e1e24a137da45ffd9 WatchSource:0}: Error finding container 946d4ad9cfefc0b488608ceeff8174a025c014b80e9ea38e1e24a137da45ffd9: Status 404 returned error can't find the container with id 946d4ad9cfefc0b488608ceeff8174a025c014b80e9ea38e1e24a137da45ffd9 Jul 09 14:28:48.232779 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:48.232760 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:28:48.282355 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:48.282325 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" event={"ID":"6b3a4b56-ef2f-4354-88d8-21254b9ca510","Type":"ContainerStarted","Data":"946d4ad9cfefc0b488608ceeff8174a025c014b80e9ea38e1e24a137da45ffd9"} Jul 09 14:28:51.300455 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:51.300419 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" event={"ID":"6b3a4b56-ef2f-4354-88d8-21254b9ca510","Type":"ContainerStarted","Data":"3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211"} Jul 09 14:28:51.300827 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:51.300561 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:28:51.318311 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:51.318241 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" podStartSLOduration=2.026261371 podStartE2EDuration="4.318221632s" totalImagesPullingTime="2.291960261s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:28:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:28:51.317541685 +0000 UTC m=+1564.133951956" watchObservedRunningTime="2026-07-09 14:28:51.318221632 +0000 UTC m=+1564.134631906" Jul 09 14:28:57.310618 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:28:57.310590 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:29:58.609134 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.609093 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw"] Jul 09 14:29:58.609655 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.609334 2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" podUID="6b3a4b56-ef2f-4354-88d8-21254b9ca510" containerName="maas-api" containerID="cri-o://3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211" gracePeriod=30 Jul 09 14:29:58.850471 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.850450 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:29:58.987803 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.987759 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b3a4b56-ef2f-4354-88d8-21254b9ca510-maas-api-tls\") pod \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " Jul 09 14:29:58.987991 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.987851 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn5lp\" (UniqueName: \"kubernetes.io/projected/6b3a4b56-ef2f-4354-88d8-21254b9ca510-kube-api-access-zn5lp\") pod \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " Jul 09 14:29:58.987991 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.987920 2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3a4b56-ef2f-4354-88d8-21254b9ca510-openshift-service-ca\") pod \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\" (UID: \"6b3a4b56-ef2f-4354-88d8-21254b9ca510\") " Jul 09 14:29:58.988284 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.988262 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b3a4b56-ef2f-4354-88d8-21254b9ca510-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6b3a4b56-ef2f-4354-88d8-21254b9ca510" (UID: "6b3a4b56-ef2f-4354-88d8-21254b9ca510"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 14:29:58.989883 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.989862 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6b3a4b56-ef2f-4354-88d8-21254b9ca510-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6b3a4b56-ef2f-4354-88d8-21254b9ca510" (UID: "6b3a4b56-ef2f-4354-88d8-21254b9ca510"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 14:29:58.989957 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:58.989931 2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b3a4b56-ef2f-4354-88d8-21254b9ca510-kube-api-access-zn5lp" (OuterVolumeSpecName: "kube-api-access-zn5lp") pod "6b3a4b56-ef2f-4354-88d8-21254b9ca510" (UID: "6b3a4b56-ef2f-4354-88d8-21254b9ca510"). InnerVolumeSpecName "kube-api-access-zn5lp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 14:29:59.089305 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.089265 2556 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6b3a4b56-ef2f-4354-88d8-21254b9ca510-openshift-service-ca\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:29:59.089305 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.089301 2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6b3a4b56-ef2f-4354-88d8-21254b9ca510-maas-api-tls\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:29:59.089305 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.089310 2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn5lp\" (UniqueName: \"kubernetes.io/projected/6b3a4b56-ef2f-4354-88d8-21254b9ca510-kube-api-access-zn5lp\") on node \"ip-10-0-134-157.ec2.internal\" DevicePath \"\"" Jul 09 14:29:59.592269 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.592237 2556 generic.go:356] "Generic (PLEG): container finished" podID="6b3a4b56-ef2f-4354-88d8-21254b9ca510" containerID="3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211" exitCode=0 Jul 09 14:29:59.592439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.592297 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" Jul 09 14:29:59.592439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.592323 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" event={"ID":"6b3a4b56-ef2f-4354-88d8-21254b9ca510","Type":"ContainerDied","Data":"3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211"} Jul 09 14:29:59.592439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.592391 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw" event={"ID":"6b3a4b56-ef2f-4354-88d8-21254b9ca510","Type":"ContainerDied","Data":"946d4ad9cfefc0b488608ceeff8174a025c014b80e9ea38e1e24a137da45ffd9"} Jul 09 14:29:59.592439 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.592425 2556 scope.go:117] "RemoveContainer" containerID="3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211" Jul 09 14:29:59.605384 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.605271 2556 scope.go:117] "RemoveContainer" containerID="3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211" Jul 09 14:29:59.605808 ip-10-0-134-157 kubenswrapper[2556]: E0709 14:29:59.605775 2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211\": container with ID starting with 3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211 not found: ID does not exist" containerID="3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211" Jul 09 14:29:59.605906 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.605817 2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211"} err="failed to get container status \"3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211\": rpc error: code = NotFound desc = could not find container \"3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211\": container with ID starting with 3b7b9fb98010c96c5cf8e65d7a1a97fe38c8445fb144272cf1f5800aba42f211 not found: ID does not exist" Jul 09 14:29:59.617511 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.617488 2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw"] Jul 09 14:29:59.625785 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.625765 2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-61b35f5d-65d54f4746-db5xw"] Jul 09 14:29:59.754982 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:29:59.754949 2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b3a4b56-ef2f-4354-88d8-21254b9ca510" path="/var/lib/kubelet/pods/6b3a4b56-ef2f-4354-88d8-21254b9ca510/volumes" Jul 09 14:30:00.141869 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.141829 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr"] Jul 09 14:30:00.142202 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.142188 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b3a4b56-ef2f-4354-88d8-21254b9ca510" containerName="maas-api" Jul 09 14:30:00.142252 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.142205 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b3a4b56-ef2f-4354-88d8-21254b9ca510" containerName="maas-api" Jul 09 14:30:00.142304 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.142294 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b3a4b56-ef2f-4354-88d8-21254b9ca510" containerName="maas-api" Jul 09 14:30:00.145095 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.145077 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" Jul 09 14:30:00.147477 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.147463 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lbp2r\"" Jul 09 14:30:00.153880 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.153854 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr"] Jul 09 14:30:00.155379 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.155360 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" Jul 09 14:30:00.292850 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.292819 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr"] Jul 09 14:30:00.296047 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:30:00.296003 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1e0ac8a_f544_48f1_bfa4_c194d49dc427.slice/crio-81f832e1f8740228568a61a2620d802f44560c1d847e60d39632ab3b90109273 WatchSource:0}: Error finding container 81f832e1f8740228568a61a2620d802f44560c1d847e60d39632ab3b90109273: Status 404 returned error can't find the container with id 81f832e1f8740228568a61a2620d802f44560c1d847e60d39632ab3b90109273 Jul 09 14:30:00.597348 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:00.597317 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" event={"ID":"b1e0ac8a-f544-48f1-bfa4-c194d49dc427","Type":"ContainerStarted","Data":"81f832e1f8740228568a61a2620d802f44560c1d847e60d39632ab3b90109273"} Jul 09 14:30:03.612491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:03.612465 2556 generic.go:356] "Generic (PLEG): container finished" podID="b1e0ac8a-f544-48f1-bfa4-c194d49dc427" containerID="46d89670c7276d07c54deadea6816d2924d5b7786d0d41c0b9840ab8be150c34" exitCode=0 Jul 09 14:30:03.612836 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:03.612556 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" event={"ID":"b1e0ac8a-f544-48f1-bfa4-c194d49dc427","Type":"ContainerDied","Data":"46d89670c7276d07c54deadea6816d2924d5b7786d0d41c0b9840ab8be150c34"} Jul 09 14:30:04.752515 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:04.752490 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" Jul 09 14:30:05.623038 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:05.622994 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" Jul 09 14:30:05.623038 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:05.623035 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726790-rmzxr" event={"ID":"b1e0ac8a-f544-48f1-bfa4-c194d49dc427","Type":"ContainerDied","Data":"81f832e1f8740228568a61a2620d802f44560c1d847e60d39632ab3b90109273"} Jul 09 14:30:05.623253 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:30:05.623084 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81f832e1f8740228568a61a2620d802f44560c1d847e60d39632ab3b90109273" Jul 09 14:32:47.719557 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:32:47.719440 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:32:47.723644 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:32:47.722130 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:37:47.746290 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:37:47.746174 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:37:47.750616 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:37:47.749848 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:42:47.773058 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:42:47.772930 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:42:47.776993 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:42:47.776844 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:45:00.137113 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.137003 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882"] Jul 09 14:45:00.137669 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.137485 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1e0ac8a-f544-48f1-bfa4-c194d49dc427" containerName="cleanup" Jul 09 14:45:00.137669 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.137503 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1e0ac8a-f544-48f1-bfa4-c194d49dc427" containerName="cleanup" Jul 09 14:45:00.137669 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.137595 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1e0ac8a-f544-48f1-bfa4-c194d49dc427" containerName="cleanup" Jul 09 14:45:00.140554 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.140534 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" Jul 09 14:45:00.142807 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.142788 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lbp2r\"" Jul 09 14:45:00.147700 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.147676 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882"] Jul 09 14:45:00.151119 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.151094 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" Jul 09 14:45:00.277699 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.277674 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882"] Jul 09 14:45:00.279909 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:45:00.279876 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bf89913_a597_4197_878a_4d98f8c7de1a.slice/crio-5a58d399c8dc79a85307a5f2e24938e34721f32134b265f40c26f3578afa9b9e WatchSource:0}: Error finding container 5a58d399c8dc79a85307a5f2e24938e34721f32134b265f40c26f3578afa9b9e: Status 404 returned error can't find the container with id 5a58d399c8dc79a85307a5f2e24938e34721f32134b265f40c26f3578afa9b9e Jul 09 14:45:00.427914 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:00.427835 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" event={"ID":"9bf89913-a597-4197-878a-4d98f8c7de1a","Type":"ContainerStarted","Data":"5a58d399c8dc79a85307a5f2e24938e34721f32134b265f40c26f3578afa9b9e"} Jul 09 14:45:01.433491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:01.433397 2556 generic.go:356] "Generic (PLEG): container finished" podID="9bf89913-a597-4197-878a-4d98f8c7de1a" containerID="66653e7a3823a032fa323e73a7c1ee8f00957a4f4dd6643d589117eda8831f08" exitCode=0 Jul 09 14:45:01.433491 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:01.433457 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" event={"ID":"9bf89913-a597-4197-878a-4d98f8c7de1a","Type":"ContainerDied","Data":"66653e7a3823a032fa323e73a7c1ee8f00957a4f4dd6643d589117eda8831f08"} Jul 09 14:45:02.563359 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:02.563336 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" Jul 09 14:45:03.442475 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:03.442447 2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" Jul 09 14:45:03.442475 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:03.442465 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726805-2p882" event={"ID":"9bf89913-a597-4197-878a-4d98f8c7de1a","Type":"ContainerDied","Data":"5a58d399c8dc79a85307a5f2e24938e34721f32134b265f40c26f3578afa9b9e"} Jul 09 14:45:03.442688 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:45:03.442516 2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a58d399c8dc79a85307a5f2e24938e34721f32134b265f40c26f3578afa9b9e" Jul 09 14:47:33.849185 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:33.849150 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-cjqpl_416c8b0c-1a8a-49ab-9a8d-9500b6480304/copy-manifests/0.log" Jul 09 14:47:33.856444 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:33.856419 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-cjqpl_416c8b0c-1a8a-49ab-9a8d-9500b6480304/manager/0.log" Jul 09 14:47:34.729401 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:34.729372 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29726790-rmzxr_b1e0ac8a-f544-48f1-bfa4-c194d49dc427/cleanup/0.log" Jul 09 14:47:34.844098 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:34.844070 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29726805-2p882_9bf89913-a597-4197-878a-4d98f8c7de1a/cleanup/0.log" Jul 09 14:47:36.917275 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:36.917203 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8qlc6_d93a8745-14fe-462f-b5ad-f44d35c8e3d8/manager/0.log" Jul 09 14:47:37.793338 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:37.793285 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6dccbd4-v98zb_66865c31-3d46-497b-87c4-7413e0611974/kube-auth-proxy/0.log" Jul 09 14:47:38.831622 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:38.831589 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-pqdzv_f49b63c8-02ab-4fef-a0b9-997977534cd0/main/0.log" Jul 09 14:47:39.058135 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:39.058049 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbz6snk_ad0a75ef-2235-440f-92a1-5840fc0e1fba/main/0.log" Jul 09 14:47:43.759316 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.759286 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqx2q/must-gather-674bv"] Jul 09 14:47:43.759663 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.759618 2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bf89913-a597-4197-878a-4d98f8c7de1a" containerName="cleanup" Jul 09 14:47:43.759663 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.759628 2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bf89913-a597-4197-878a-4d98f8c7de1a" containerName="cleanup" Jul 09 14:47:43.759739 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.759691 2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bf89913-a597-4197-878a-4d98f8c7de1a" containerName="cleanup" Jul 09 14:47:43.762728 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.762710 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:43.765124 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.765101 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqx2q\"/\"kube-root-ca.crt\"" Jul 09 14:47:43.765980 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.765959 2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-gqx2q\"/\"default-dockercfg-4vx79\"" Jul 09 14:47:43.766068 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.766000 2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-gqx2q\"/\"openshift-service-ca.crt\"" Jul 09 14:47:43.771806 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.771786 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx2q/must-gather-674bv"] Jul 09 14:47:43.828635 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.828603 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hprj5\" (UniqueName: \"kubernetes.io/projected/d4be0be8-0872-4862-bd10-60386c2669b1-kube-api-access-hprj5\") pod \"must-gather-674bv\" (UID: \"d4be0be8-0872-4862-bd10-60386c2669b1\") " pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:43.828787 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.828655 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4be0be8-0872-4862-bd10-60386c2669b1-must-gather-output\") pod \"must-gather-674bv\" (UID: \"d4be0be8-0872-4862-bd10-60386c2669b1\") " pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:43.929985 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.929948 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hprj5\" (UniqueName: \"kubernetes.io/projected/d4be0be8-0872-4862-bd10-60386c2669b1-kube-api-access-hprj5\") pod \"must-gather-674bv\" (UID: \"d4be0be8-0872-4862-bd10-60386c2669b1\") " pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:43.930180 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.930039 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4be0be8-0872-4862-bd10-60386c2669b1-must-gather-output\") pod \"must-gather-674bv\" (UID: \"d4be0be8-0872-4862-bd10-60386c2669b1\") " pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:43.930351 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.930335 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d4be0be8-0872-4862-bd10-60386c2669b1-must-gather-output\") pod \"must-gather-674bv\" (UID: \"d4be0be8-0872-4862-bd10-60386c2669b1\") " pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:43.943521 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:43.943499 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hprj5\" (UniqueName: \"kubernetes.io/projected/d4be0be8-0872-4862-bd10-60386c2669b1-kube-api-access-hprj5\") pod \"must-gather-674bv\" (UID: \"d4be0be8-0872-4862-bd10-60386c2669b1\") " pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:44.072394 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:44.072320 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx2q/must-gather-674bv" Jul 09 14:47:44.200955 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:44.200931 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx2q/must-gather-674bv"] Jul 09 14:47:44.202733 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:47:44.202705 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4be0be8_0872_4862_bd10_60386c2669b1.slice/crio-0f5cd5a91ea491c33f7b2b48ed63ae35550277dc682bb75c5782d9b74f6a7e56 WatchSource:0}: Error finding container 0f5cd5a91ea491c33f7b2b48ed63ae35550277dc682bb75c5782d9b74f6a7e56: Status 404 returned error can't find the container with id 0f5cd5a91ea491c33f7b2b48ed63ae35550277dc682bb75c5782d9b74f6a7e56 Jul 09 14:47:44.204535 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:44.204514 2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 14:47:45.153603 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:45.153562 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/must-gather-674bv" event={"ID":"d4be0be8-0872-4862-bd10-60386c2669b1","Type":"ContainerStarted","Data":"0f5cd5a91ea491c33f7b2b48ed63ae35550277dc682bb75c5782d9b74f6a7e56"} Jul 09 14:47:46.162358 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:46.162307 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/must-gather-674bv" event={"ID":"d4be0be8-0872-4862-bd10-60386c2669b1","Type":"ContainerStarted","Data":"1a037a97108f671a1b2a7d30e50addb41ac998f8f0e457fab221dff1833ba634"} Jul 09 14:47:46.162915 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:46.162377 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/must-gather-674bv" event={"ID":"d4be0be8-0872-4862-bd10-60386c2669b1","Type":"ContainerStarted","Data":"54ef32059b03e1d0141ea688ec1d1572838d0b1a914bfeac7a2dbe7e46fc5261"} Jul 09 14:47:46.181663 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:46.181598 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqx2q/must-gather-674bv" podStartSLOduration=2.230458523 podStartE2EDuration="3.181577132s" totalImagesPullingTime="951.118609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:47:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:47:46.180257265 +0000 UTC m=+2698.996667537" watchObservedRunningTime="2026-07-09 14:47:46.181577132 +0000 UTC m=+2698.997987404" Jul 09 14:47:46.803609 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:46.803580 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-rq9hz_cfce2ae6-b062-48df-be52-85feb542d036/global-pull-secret-syncer/0.log" Jul 09 14:47:46.909666 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:46.909638 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-zv2jl_bd20c943-3b87-483f-b184-857d02f8a052/konnectivity-agent/0.log" Jul 09 14:47:46.956609 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:46.956578 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-157.ec2.internal_7e41281165752ad9f9482a713a6ad085/haproxy/0.log" Jul 09 14:47:47.829332 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:47.829229 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:47:47.847082 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:47.831211 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-db4dx_beac0780-2d58-49c7-acfd-0460b986dedb/ovn-acl-logging/0.log" Jul 09 14:47:52.476032 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:52.474866 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-8qlc6_d93a8745-14fe-462f-b5ad-f44d35c8e3d8/manager/0.log" Jul 09 14:47:54.876466 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:54.876387 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxj9f_996636c4-7a3e-450f-b425-0ba5d62940a7/node-exporter/0.log" Jul 09 14:47:54.909827 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:54.909796 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxj9f_996636c4-7a3e-450f-b425-0ba5d62940a7/kube-rbac-proxy/0.log" Jul 09 14:47:54.929773 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:54.929744 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xxj9f_996636c4-7a3e-450f-b425-0ba5d62940a7/init-textfile/0.log" Jul 09 14:47:54.954404 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:54.954374 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tbvfh_5520eb18-9b85-4082-bb02-fa3962dc9991/kube-rbac-proxy-main/0.log" Jul 09 14:47:54.978918 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:54.978890 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tbvfh_5520eb18-9b85-4082-bb02-fa3962dc9991/kube-rbac-proxy-self/0.log" Jul 09 14:47:55.000733 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.000705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-tbvfh_5520eb18-9b85-4082-bb02-fa3962dc9991/openshift-state-metrics/0.log" Jul 09 14:47:55.030195 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.030167 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/prometheus/0.log" Jul 09 14:47:55.051085 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.051055 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/config-reloader/0.log" Jul 09 14:47:55.073495 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.073461 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/thanos-sidecar/0.log" Jul 09 14:47:55.099599 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.099568 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/kube-rbac-proxy-web/0.log" Jul 09 14:47:55.122423 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.122395 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/kube-rbac-proxy/0.log" Jul 09 14:47:55.142966 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.142872 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/kube-rbac-proxy-thanos/0.log" Jul 09 14:47:55.166942 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.166910 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d396f360-e05f-473a-bf09-621c6068626d/init-config-reloader/0.log" Jul 09 14:47:55.198108 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.198078 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ktk2r_1b8643ff-5005-42ac-a08e-8c73a989cc04/prometheus-operator/0.log" Jul 09 14:47:55.215721 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.215694 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-ktk2r_1b8643ff-5005-42ac-a08e-8c73a989cc04/kube-rbac-proxy/0.log" Jul 09 14:47:55.241135 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:55.241111 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-n5nv5_829699e3-e590-4a4c-9f00-5c4e8c7596b8/prometheus-operator-admission-webhook/0.log" Jul 09 14:47:56.633881 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.633847 2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6"] Jul 09 14:47:56.639115 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.639073 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.650027 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.649989 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6"] Jul 09 14:47:56.666433 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.666401 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-podres\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.666718 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.666694 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-proc\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.666939 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.666921 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-sys\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.667171 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.667127 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-lib-modules\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.667368 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.667350 2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdh49\" (UniqueName: \"kubernetes.io/projected/2b478a2a-860e-40af-9863-331c7f53713b-kube-api-access-kdh49\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.769068 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769026 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-sys\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.769294 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769272 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-sys\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.769427 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769322 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-lib-modules\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.769566 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769551 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdh49\" (UniqueName: \"kubernetes.io/projected/2b478a2a-860e-40af-9863-331c7f53713b-kube-api-access-kdh49\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.769700 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769687 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-podres\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.769825 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769812 2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-proc\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.770028 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769997 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-proc\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.770146 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.769442 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-lib-modules\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.770356 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.770338 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/2b478a2a-860e-40af-9863-331c7f53713b-podres\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.781031 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.780630 2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdh49\" (UniqueName: \"kubernetes.io/projected/2b478a2a-860e-40af-9863-331c7f53713b-kube-api-access-kdh49\") pod \"perf-node-gather-daemonset-z57g6\" (UID: \"2b478a2a-860e-40af-9863-331c7f53713b\") " pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:56.952535 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:56.952494 2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:57.149031 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:57.146060 2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6"] Jul 09 14:47:57.158069 ip-10-0-134-157 kubenswrapper[2556]: W0709 14:47:57.158034 2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2b478a2a_860e_40af_9863_331c7f53713b.slice/crio-1549e6a96ad005099f303c18b01478db1942a340f527876c984a5c79bf17125e WatchSource:0}: Error finding container 1549e6a96ad005099f303c18b01478db1942a340f527876c984a5c79bf17125e: Status 404 returned error can't find the container with id 1549e6a96ad005099f303c18b01478db1942a340f527876c984a5c79bf17125e Jul 09 14:47:57.240899 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:57.240838 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" event={"ID":"2b478a2a-860e-40af-9863-331c7f53713b","Type":"ContainerStarted","Data":"1549e6a96ad005099f303c18b01478db1942a340f527876c984a5c79bf17125e"} Jul 09 14:47:57.928273 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:57.928237 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-4bpcx_c6e2059c-e108-471c-b70f-e2a6106c0486/download-server/0.log" Jul 09 14:47:58.248979 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:58.248949 2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" event={"ID":"2b478a2a-860e-40af-9863-331c7f53713b","Type":"ContainerStarted","Data":"a00f4a9883eb8ad87889eb860bf5b7182474fbcafb71830eb8c610fc943ef2d7"} Jul 09 14:47:58.249186 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:58.249136 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:47:58.268423 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:58.268375 2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" podStartSLOduration=2.268359059 podStartE2EDuration="2.268359059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:47:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:47:58.266787027 +0000 UTC m=+2711.083197300" watchObservedRunningTime="2026-07-09 14:47:58.268359059 +0000 UTC m=+2711.084769329" Jul 09 14:47:59.677147 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:59.677108 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h5zc8_3bf72a99-1009-4a83-9ab6-9393ac5b4814/dns/0.log" Jul 09 14:47:59.727368 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:59.727335 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-h5zc8_3bf72a99-1009-4a83-9ab6-9393ac5b4814/kube-rbac-proxy/0.log" Jul 09 14:47:59.854261 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:47:59.854235 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-vwhwx_6afc7b62-c78d-468c-b8d3-e388a2e7c72d/dns-node-resolver/0.log" Jul 09 14:48:00.426524 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:00.426495 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6fc5b7b4b6-7klcj_84020448-c2b8-4b55-93d7-79764f39ddab/registry/0.log" Jul 09 14:48:00.448138 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:00.448111 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8x95m_d515e7d4-398c-47b2-963d-c7a9f8f83498/node-ca/0.log" Jul 09 14:48:01.694752 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:01.694714 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6dccbd4-v98zb_66865c31-3d46-497b-87c4-7413e0611974/kube-auth-proxy/0.log" Jul 09 14:48:02.570542 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:02.570516 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-4q4vz_7e3b6086-726b-4e5c-a5a4-9b5fcf9c6f2f/serve-healthcheck-canary/0.log" Jul 09 14:48:03.186094 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:03.186067 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-czpxj_3d6a9444-ed1f-430a-a10f-b4696c5ef64b/kube-rbac-proxy/0.log" Jul 09 14:48:03.205471 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:03.205439 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-czpxj_3d6a9444-ed1f-430a-a10f-b4696c5ef64b/exporter/0.log" Jul 09 14:48:03.226688 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:03.226649 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-czpxj_3d6a9444-ed1f-430a-a10f-b4696c5ef64b/extractor/0.log" Jul 09 14:48:04.264677 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:04.264650 2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-gqx2q/perf-node-gather-daemonset-z57g6" Jul 09 14:48:05.740652 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:05.740615 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-cjqpl_416c8b0c-1a8a-49ab-9a8d-9500b6480304/manager/0.log" Jul 09 14:48:05.761751 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:05.761709 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6f67568454-cjqpl_416c8b0c-1a8a-49ab-9a8d-9500b6480304/copy-manifests/0.log" Jul 09 14:48:07.185632 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:07.185600 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-677b74f79f-cmwqf_8629163e-4557-4ff7-bbe1-12276f74a2b7/manager/0.log" Jul 09 14:48:07.235228 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:07.235197 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-hzm7k_a531d688-ece0-4046-a6e0-dd2c6fecc663/openshift-lws-operator/0.log" Jul 09 14:48:07.269740 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:07.269714 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6dccbd4-v98zb_66865c31-3d46-497b-87c4-7413e0611974/kube-auth-proxy/0.log" Jul 09 14:48:08.642407 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:08.642381 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79b6dccbd4-v98zb_66865c31-3d46-497b-87c4-7413e0611974/kube-auth-proxy/0.log" Jul 09 14:48:13.754380 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:13.754347 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ds25h_772dfbee-a87a-4c43-a2f7-9179242798b2/kube-multus-additional-cni-plugins/0.log" Jul 09 14:48:13.781503 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:13.781469 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ds25h_772dfbee-a87a-4c43-a2f7-9179242798b2/egress-router-binary-copy/0.log" Jul 09 14:48:13.815828 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:13.815805 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ds25h_772dfbee-a87a-4c43-a2f7-9179242798b2/cni-plugins/0.log" Jul 09 14:48:13.836736 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:13.836705 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ds25h_772dfbee-a87a-4c43-a2f7-9179242798b2/bond-cni-plugin/0.log" Jul 09 14:48:13.861619 ip-10-0-134-157 kubenswrapper[2556]: I0709 14:48:13.861593 2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ds25h_772dfbee-a87a-4c43-a2f7-9179242798b2/routeoverride-cni/0.log"