Jul 09 22:25:53.656622 ip-10-0-139-240 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 09 22:25:53.656633 ip-10-0-139-240 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 09 22:25:53.656640 ip-10-0-139-240 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 09 22:25:53.656879 ip-10-0-139-240 systemd[1]: Failed to start Kubernetes Kubelet. Jul 09 22:26:03.816977 ip-10-0-139-240 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 09 22:26:03.816997 ip-10-0-139-240 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 63b5b45200324baca2ad9f70e2ea57aa -- Jul 09 22:27:54.004474 ip-10-0-139-240 systemd[1]: Starting Kubernetes Kubelet... Jul 09 22:27:54.323742 ip-10-0-139-240 kubenswrapper[2552]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 22:27:54.323742 ip-10-0-139-240 kubenswrapper[2552]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 22:27:54.323742 ip-10-0-139-240 kubenswrapper[2552]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 22:27:54.323742 ip-10-0-139-240 kubenswrapper[2552]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 22:27:54.323742 ip-10-0-139-240 kubenswrapper[2552]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 22:27:54.325698 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.325599 2552 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 22:27:54.329573 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329559 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:27:54.329573 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329572 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329576 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329581 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329584 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329587 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329590 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329592 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329595 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329597 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329599 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329602 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329604 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329607 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329609 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329611 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329614 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329616 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329619 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329621 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329624 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:27:54.329635 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329627 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329631 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329635 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329638 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329641 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329645 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329655 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329658 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329661 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329663 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329666 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329668 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329671 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329674 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329677 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329679 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329681 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329684 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329686 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:27:54.330074 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329689 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329691 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329694 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329696 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329698 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329700 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329703 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329705 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329709 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329712 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329715 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329717 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329720 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329723 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329725 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329728 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329731 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329734 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329736 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:27:54.330574 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329739 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329741 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329743 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329746 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329748 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329751 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329753 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329755 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329757 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329760 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329762 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329765 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329767 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329772 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329776 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329778 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329781 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329783 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329787 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329790 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:27:54.331010 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329792 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329795 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329797 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329799 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329802 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329804 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329807 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329809 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329812 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329815 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329817 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329820 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329823 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329825 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329828 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329830 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329833 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329835 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329837 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.329840 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:27:54.331478 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330512 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330519 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330521 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330524 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330527 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330530 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330533 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330535 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330538 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330541 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330543 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330566 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330570 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330573 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330576 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330579 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330582 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330585 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330588 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330591 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:27:54.331965 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330594 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330597 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330599 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330602 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330605 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330607 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330610 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330612 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330615 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330618 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330620 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330623 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330625 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330628 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330630 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330633 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330635 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330639 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330641 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330643 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:27:54.332456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330647 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330652 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330655 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330657 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330663 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330666 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330668 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330671 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330674 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330676 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330679 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330683 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330687 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330690 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330693 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330696 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330699 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330702 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330704 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330707 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:27:54.332958 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330710 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330712 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330715 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330718 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330720 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330723 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330725 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330728 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330730 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330733 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330735 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330738 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330740 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330743 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330746 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330748 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330750 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330753 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330757 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330760 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:27:54.333451 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330763 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330766 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330769 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330772 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330775 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330778 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330781 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330783 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330786 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330789 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330791 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330794 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330796 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330799 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330802 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330805 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330808 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330810 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.330813 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331140 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:27:54.333908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331145 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331148 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331150 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331153 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331171 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331174 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331177 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331179 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331182 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331184 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331187 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331190 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331194 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331197 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331200 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331203 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331206 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331209 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331211 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:27:54.334401 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331214 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331216 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331219 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331221 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331223 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331227 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331231 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331234 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331236 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331238 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331241 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331243 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331246 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331248 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331251 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331253 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331257 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331260 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331263 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:27:54.334849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331266 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331268 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331271 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331273 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331282 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331285 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331287 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331290 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331292 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331295 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331298 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331300 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331303 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331306 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331308 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331311 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331313 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331315 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331318 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331320 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:27:54.335298 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331323 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331325 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331327 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331330 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331332 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331335 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331337 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331340 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331342 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331344 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331347 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331349 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331351 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331354 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331356 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331358 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331362 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331369 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331372 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331375 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:27:54.335773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331377 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331379 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331382 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331385 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331388 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331391 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331393 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331396 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331398 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331400 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331403 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331405 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331408 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331410 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331412 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331415 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331417 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331420 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331422 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.331425 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:27:54.336277 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331493 2552 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331499 2552 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331505 2552 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331509 2552 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331513 2552 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331515 2552 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331519 2552 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331525 2552 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331528 2552 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331533 2552 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331540 2552 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331545 2552 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331548 2552 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331553 2552 flags.go:64] FLAG: --cgroup-root="" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331558 2552 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331562 2552 flags.go:64] FLAG: --client-ca-file="" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331567 2552 flags.go:64] FLAG: --cloud-provider="external" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331569 2552 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331573 2552 flags.go:64] FLAG: --cluster-domain="" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331575 2552 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331578 2552 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331581 2552 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331585 2552 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331588 2552 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 22:27:54.336740 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331591 2552 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331594 2552 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331607 2552 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331611 2552 flags.go:64] FLAG: --contention-profiling="false" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331618 2552 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331621 2552 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331624 2552 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331627 2552 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331631 2552 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331634 2552 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331637 2552 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331639 2552 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331642 2552 flags.go:64] FLAG: --enable-server="true" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331645 2552 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331653 2552 flags.go:64] FLAG: --event-burst="100" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331656 2552 flags.go:64] FLAG: --event-qps="50" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331659 2552 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331662 2552 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331665 2552 flags.go:64] FLAG: --eviction-hard="" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331669 2552 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331671 2552 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331674 2552 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331677 2552 flags.go:64] FLAG: --eviction-soft="" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331680 2552 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331683 2552 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 22:27:54.337297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331685 2552 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331688 2552 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331691 2552 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331693 2552 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331696 2552 flags.go:64] FLAG: --feature-gates="" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331699 2552 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331702 2552 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331705 2552 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331708 2552 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331711 2552 flags.go:64] FLAG: --healthz-port="10248" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331713 2552 flags.go:64] FLAG: --help="false" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331717 2552 flags.go:64] FLAG: --hostname-override="ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331720 2552 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331722 2552 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331725 2552 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331728 2552 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331731 2552 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331734 2552 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331739 2552 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331741 2552 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331745 2552 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331747 2552 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331750 2552 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331753 2552 flags.go:64] FLAG: --kube-reserved="" Jul 09 22:27:54.337979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331756 2552 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331758 2552 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331761 2552 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331764 2552 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331767 2552 flags.go:64] FLAG: --lock-file="" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331770 2552 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331772 2552 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331775 2552 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331780 2552 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331782 2552 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331785 2552 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331788 2552 flags.go:64] FLAG: --logging-format="text" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331790 2552 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331793 2552 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331796 2552 flags.go:64] FLAG: --manifest-url="" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331798 2552 flags.go:64] FLAG: --manifest-url-header="" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331802 2552 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331805 2552 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331809 2552 flags.go:64] FLAG: --max-pods="110" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331812 2552 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331815 2552 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331818 2552 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331821 2552 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331824 2552 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331827 2552 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 22:27:54.339012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331829 2552 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331837 2552 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331840 2552 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331843 2552 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331846 2552 flags.go:64] FLAG: --pod-cidr="" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331849 2552 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331854 2552 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331857 2552 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331859 2552 flags.go:64] FLAG: --pods-per-core="0" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331862 2552 flags.go:64] FLAG: --port="10250" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331865 2552 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331869 2552 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-096e20a8630b45122" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331872 2552 flags.go:64] FLAG: --qos-reserved="" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331875 2552 flags.go:64] FLAG: --read-only-port="10255" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331877 2552 flags.go:64] FLAG: --register-node="true" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331880 2552 flags.go:64] FLAG: --register-with-taints="" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331883 2552 flags.go:64] FLAG: --registry-burst="10" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331886 2552 flags.go:64] FLAG: --registry-qps="5" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331889 2552 flags.go:64] FLAG: --reserved-cpus="" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331892 2552 flags.go:64] FLAG: --reserved-memory="" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331895 2552 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331898 2552 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331901 2552 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331903 2552 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331906 2552 flags.go:64] FLAG: --runonce="false" Jul 09 22:27:54.340051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331909 2552 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331913 2552 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331916 2552 flags.go:64] FLAG: --seccomp-default="false" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331919 2552 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331922 2552 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331924 2552 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331927 2552 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331930 2552 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331933 2552 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331936 2552 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331939 2552 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331942 2552 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331945 2552 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331948 2552 flags.go:64] FLAG: --system-cgroups="" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331951 2552 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331956 2552 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331958 2552 flags.go:64] FLAG: --tls-cert-file="" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331961 2552 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331965 2552 flags.go:64] FLAG: --tls-min-version="" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331968 2552 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331971 2552 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331974 2552 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331977 2552 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331980 2552 flags.go:64] FLAG: --v="2" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331983 2552 flags.go:64] FLAG: --version="false" Jul 09 22:27:54.341102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331987 2552 flags.go:64] FLAG: --vmodule="" Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331990 2552 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.331993 2552 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332100 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332104 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332107 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332110 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332113 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332118 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332121 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332123 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332125 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332128 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332131 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332133 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332136 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332139 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332142 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332145 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332147 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:27:54.342137 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332150 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332153 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332167 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332171 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332173 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332176 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332178 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332182 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332185 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332188 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332192 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332195 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332197 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332200 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332202 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332205 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332207 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332209 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332212 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332214 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:27:54.342748 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332218 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332221 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332225 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332228 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332231 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332234 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332236 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332239 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332242 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332245 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332247 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332250 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332252 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332255 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332257 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332259 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332262 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332264 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332267 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:27:54.343617 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332269 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332272 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332274 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332277 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332279 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332281 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332284 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332286 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332289 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332291 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332294 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332296 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332299 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332302 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332305 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332307 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332310 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332312 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332315 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332317 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:27:54.344239 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332320 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332323 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332326 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332328 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332331 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332333 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332335 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332338 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332340 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332343 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332345 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332348 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332350 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332353 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332355 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332358 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332360 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332362 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332365 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:27:54.344791 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332369 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332372 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332374 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.332377 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.333039 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.340485 2552 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.340505 2552 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.340530 2552 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.340538 2552 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340629 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340637 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340642 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340646 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340651 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340655 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:27:54.345345 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340660 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340664 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340670 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340676 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340681 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340685 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340690 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340694 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340699 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340704 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340708 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340713 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340717 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340721 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340726 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340730 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340734 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340738 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340742 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340746 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:27:54.345751 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340751 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340755 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340759 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340771 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340776 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340781 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340785 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340789 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340793 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340797 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340801 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340806 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340810 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340814 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340818 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340822 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340826 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340830 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340834 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340838 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:27:54.346271 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340843 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340847 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340851 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340855 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340859 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340862 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340867 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340871 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340875 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340879 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340883 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340887 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340891 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340895 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340900 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340904 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340916 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340921 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340925 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340929 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:27:54.346797 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340933 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340937 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340941 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340945 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340949 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340953 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340957 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340961 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340966 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340970 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340974 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340978 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340982 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340986 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340990 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340995 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.340998 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341003 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341007 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341011 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:27:54.347355 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341015 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341019 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341025 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341032 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341039 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341043 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341047 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341052 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341056 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341068 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341079 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341083 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341087 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.341095 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 22:27:54.347852 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341324 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341332 2552 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341337 2552 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341341 2552 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341345 2552 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341349 2552 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341353 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341357 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341361 2552 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341365 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341369 2552 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341373 2552 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341377 2552 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341381 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341385 2552 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341389 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341394 2552 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341397 2552 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341403 2552 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341409 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 22:27:54.348212 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341414 2552 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341419 2552 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341423 2552 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341428 2552 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341432 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341436 2552 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341441 2552 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341445 2552 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341456 2552 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341461 2552 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341465 2552 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341469 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341473 2552 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341477 2552 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341481 2552 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341484 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341488 2552 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341493 2552 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341497 2552 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 22:27:54.348897 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341504 2552 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341509 2552 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341513 2552 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341518 2552 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341522 2552 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341526 2552 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341530 2552 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341534 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341539 2552 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341543 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341547 2552 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341550 2552 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341554 2552 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341558 2552 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341562 2552 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341566 2552 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341570 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341574 2552 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341578 2552 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341582 2552 feature_gate.go:328] unrecognized feature gate: Example Jul 09 22:27:54.350005 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341586 2552 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341590 2552 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341602 2552 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341606 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341610 2552 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341614 2552 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341618 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341622 2552 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341626 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341630 2552 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341634 2552 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341638 2552 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341642 2552 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341646 2552 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341651 2552 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341655 2552 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341659 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341663 2552 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341667 2552 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341671 2552 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 22:27:54.350849 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341675 2552 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341679 2552 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341683 2552 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341687 2552 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341691 2552 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341695 2552 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341699 2552 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341703 2552 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341707 2552 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341712 2552 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341716 2552 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341720 2552 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341724 2552 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341728 2552 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341733 2552 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341746 2552 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341751 2552 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341755 2552 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341759 2552 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 22:27:54.351625 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:54.341763 2552 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.341770 2552 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.341955 2552 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.345292 2552 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.346470 2552 server.go:1019] "Starting client certificate rotation" Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.346568 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.346595 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 22:27:54.352283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.349138 2552 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 22:27:54.354057 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.354031 2552 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 22:27:54.364761 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.364744 2552 log.go:25] "Validated CRI v1 runtime API" Jul 09 22:27:54.366759 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.366737 2552 log.go:25] "Validated CRI v1 image API" Jul 09 22:27:54.367668 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.367651 2552 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 22:27:54.372751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.372726 2552 fs.go:135] Filesystem UUIDs: map[2d5bf30b-033a-4db8-8c7b-82f12bfaacc1:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c162286d-04fa-49e0-82d6-6e9bed289658:/dev/nvme0n1p4] Jul 09 22:27:54.372822 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.372750 2552 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 22:27:54.377456 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.377354 2552 manager.go:216] Machine: {Timestamp:2026-07-09 22:27:54.376174982 +0000 UTC m=+0.274957801 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3215265 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e06278628704df36e502efdfb4372 SystemUUID:ec2e0627-8628-704d-f36e-502efdfb4372 BootID:63b5b452-0032-4bac-a2ad-9f70e2ea57aa Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f3:11:69:3b:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f3:11:69:3b:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:2e:f6:9f:b3:5a:ba Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 22:27:54.377456 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.377448 2552 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 22:27:54.377561 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.377537 2552 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 22:27:54.380218 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.380170 2552 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 22:27:54.380396 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.380218 2552 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-240.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 22:27:54.380891 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.380881 2552 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 22:27:54.380924 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.380895 2552 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 22:27:54.380924 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.380904 2552 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 22:27:54.381931 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.381919 2552 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 22:27:54.383047 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.383028 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 22:27:54.383149 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.383136 2552 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 22:27:54.386955 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.386942 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 09 22:27:54.387080 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387069 2552 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 22:27:54.387116 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387111 2552 kubelet.go:486] "Attempting to sync node with API server" Jul 09 22:27:54.387171 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387131 2552 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 22:27:54.387171 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387153 2552 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 22:27:54.387268 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387179 2552 kubelet.go:398] "Adding apiserver pod source" Jul 09 22:27:54.387268 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387191 2552 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 22:27:54.387541 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387529 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 22:27:54.387604 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.387550 2552 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 22:27:54.389393 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.389377 2552 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 09 22:27:54.391146 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.391134 2552 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 22:27:54.391193 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.391172 2552 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 22:27:54.392115 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392105 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 22:27:54.392150 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392119 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 22:27:54.392150 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392125 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 22:27:54.392150 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392130 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 22:27:54.392150 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392139 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 22:27:54.392150 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392145 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 22:27:54.392282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392153 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 22:27:54.392282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392175 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 22:27:54.392282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392182 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 22:27:54.392282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392186 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 22:27:54.392282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392205 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 22:27:54.392282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392211 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 22:27:54.392864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392856 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 22:27:54.392864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.392864 2552 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 22:27:54.395792 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.395779 2552 server.go:1268] "Started kubelet" Jul 09 22:27:54.395886 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.395863 2552 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 22:27:54.395932 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.395877 2552 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 22:27:54.395970 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.395940 2552 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 22:27:54.398567 ip-10-0-139-240 systemd[1]: Started Kubernetes Kubelet. Jul 09 22:27:54.400197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.398584 2552 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 22:27:54.400197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.399446 2552 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-240.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 22:27:54.400197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.399714 2552 server.go:310] "Adding debug handlers to kubelet server" Jul 09 22:27:54.400197 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.399790 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 22:27:54.400197 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.399710 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 22:27:54.405637 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.405617 2552 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 22:27:54.406110 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.405373 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-240.ec2.internal.18c0bf8f3eee62a8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-240.ec2.internal,UID:ip-10-0-139-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-240.ec2.internal,},FirstTimestamp:2026-07-09 22:27:54.395755176 +0000 UTC m=+0.294537993,LastTimestamp:2026-07-09 22:27:54.395755176 +0000 UTC m=+0.294537993,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-240.ec2.internal,}" Jul 09 22:27:54.406267 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406251 2552 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 22:27:54.406267 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406261 2552 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 22:27:54.406401 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.406333 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.406927 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406827 2552 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 22:27:54.406927 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406843 2552 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 22:27:54.406927 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406897 2552 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 22:27:54.407133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406960 2552 reconstruct.go:97] "Volume reconstruction finished" Jul 09 22:27:54.407133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.406968 2552 reconciler.go:29] "Reconciler: start to sync state" Jul 09 22:27:54.407257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407148 2552 factory.go:55] Registering systemd factory Jul 09 22:27:54.407257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407179 2552 factory.go:223] Registration of the systemd container factory successfully Jul 09 22:27:54.407346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407278 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mnbjf" Jul 09 22:27:54.407346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407340 2552 factory.go:153] Registering CRI-O factory Jul 09 22:27:54.407430 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407352 2552 factory.go:223] Registration of the crio container factory successfully Jul 09 22:27:54.407430 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407399 2552 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 22:27:54.407430 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407421 2552 factory.go:103] Registering Raw factory Jul 09 22:27:54.407548 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407434 2552 manager.go:1196] Started watching for new ooms in manager Jul 09 22:27:54.407834 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.407817 2552 manager.go:349] Starting recovery of all containers Jul 09 22:27:54.416873 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.416851 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mnbjf" Jul 09 22:27:54.417526 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.417512 2552 manager.go:354] Recovery completed Jul 09 22:27:54.418621 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.418593 2552 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 22:27:54.418621 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.418598 2552 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-240.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 22:27:54.423257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.423246 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.425139 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425125 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.425235 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425147 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.425235 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425173 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.425618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425604 2552 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 22:27:54.425618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425616 2552 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 22:27:54.425707 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425632 2552 state_mem.go:36] "Initialized new in-memory state store" Jul 09 22:27:54.425707 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.425663 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.426418 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.426404 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.426480 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.426427 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.426480 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.426437 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.427675 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.427661 2552 policy_none.go:49] "None policy: Start" Jul 09 22:27:54.427739 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.427681 2552 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 22:27:54.427739 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.427693 2552 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 22:27:54.427960 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.427903 2552 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-240.ec2.internal.18c0bf8f40aeb68d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-240.ec2.internal,UID:ip-10-0-139-240.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-240.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-240.ec2.internal,},FirstTimestamp:2026-07-09 22:27:54.425136781 +0000 UTC m=+0.323919598,LastTimestamp:2026-07-09 22:27:54.425136781 +0000 UTC m=+0.323919598,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-240.ec2.internal,}" Jul 09 22:27:54.429799 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.429784 2552 policy_none.go:47] "Start" Jul 09 22:27:54.464794 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.464678 2552 manager.go:337] "Starting Device Plugin manager" Jul 09 22:27:54.464871 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.464815 2552 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 22:27:54.464871 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.464828 2552 server.go:87] "Starting device plugin registration server" Jul 09 22:27:54.465045 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.465033 2552 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 22:27:54.465090 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.465047 2552 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 22:27:54.465175 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.465140 2552 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 22:27:54.465262 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.465235 2552 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 22:27:54.465262 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.465248 2552 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 22:27:54.465825 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.465802 2552 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 22:27:54.465893 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.465849 2552 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.535832 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.535807 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 22:27:54.537958 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.536900 2552 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 22:27:54.537958 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.536934 2552 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 22:27:54.537958 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.536952 2552 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 22:27:54.537958 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.536980 2552 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 22:27:54.539505 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.539488 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:27:54.565583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.565564 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.566352 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.566337 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.566439 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.566369 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.566439 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.566384 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.566439 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.566412 2552 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.574589 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.574550 2552 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.574589 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.574572 2552 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-240.ec2.internal\": node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.594150 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.594133 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.637048 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.637028 2552 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal"] Jul 09 22:27:54.637120 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.637090 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.637983 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.637970 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.638058 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.637993 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.638058 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.638002 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.640287 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640275 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.640411 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640397 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.640473 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640431 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.640881 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640865 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.640957 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640892 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.640957 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640904 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.640957 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640864 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.641044 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640968 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.641044 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.640984 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.643139 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.643124 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.643234 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.643149 2552 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 22:27:54.643763 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.643748 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientMemory" Jul 09 22:27:54.643825 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.643771 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 22:27:54.643825 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.643783 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeHasSufficientPID" Jul 09 22:27:54.656657 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.656634 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-240.ec2.internal\" not found" node="ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.660784 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.660771 2552 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-240.ec2.internal\" not found" node="ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.694390 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.694374 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.795011 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.794993 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.808087 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.808065 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ed496b1d6fc2da995dc6aa464aec539-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal\" (UID: \"1ed496b1d6fc2da995dc6aa464aec539\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.808152 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.808088 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ed496b1d6fc2da995dc6aa464aec539-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal\" (UID: \"1ed496b1d6fc2da995dc6aa464aec539\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.808152 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.808106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40e1f116d5815810e312bf19af51fd4f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-240.ec2.internal\" (UID: \"40e1f116d5815810e312bf19af51fd4f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.895514 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.895477 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:54.908849 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.908830 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ed496b1d6fc2da995dc6aa464aec539-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal\" (UID: \"1ed496b1d6fc2da995dc6aa464aec539\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.908899 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.908854 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ed496b1d6fc2da995dc6aa464aec539-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal\" (UID: \"1ed496b1d6fc2da995dc6aa464aec539\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.908899 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.908872 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40e1f116d5815810e312bf19af51fd4f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-240.ec2.internal\" (UID: \"40e1f116d5815810e312bf19af51fd4f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.908966 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.908918 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/40e1f116d5815810e312bf19af51fd4f-config\") pod \"kube-apiserver-proxy-ip-10-0-139-240.ec2.internal\" (UID: \"40e1f116d5815810e312bf19af51fd4f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.908966 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.908930 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1ed496b1d6fc2da995dc6aa464aec539-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal\" (UID: \"1ed496b1d6fc2da995dc6aa464aec539\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.908966 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.908922 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1ed496b1d6fc2da995dc6aa464aec539-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal\" (UID: \"1ed496b1d6fc2da995dc6aa464aec539\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.959957 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.959928 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.963512 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:54.963495 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" Jul 09 22:27:54.995762 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:54.995727 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:55.099222 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:55.099177 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:55.206488 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:55.206411 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:55.309694 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:55.309656 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:55.346488 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.346462 2552 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 22:27:55.346884 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.346619 2552 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 22:27:55.410139 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:55.410116 2552 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-240.ec2.internal\" not found" Jul 09 22:27:55.414281 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.414257 2552 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:27:55.422330 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.421761 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 22:22:54 +0000 UTC" deadline="2028-03-22 03:39:33.92196238 +0000 UTC" Jul 09 22:27:55.422330 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.421809 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14909h11m38.500157735s" Jul 09 22:27:55.424459 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.424443 2552 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:27:55.467436 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.467386 2552 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:27:55.507286 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.507265 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" Jul 09 22:27:55.521158 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.521140 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 22:27:55.521924 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.521902 2552 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" Jul 09 22:27:55.535303 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:55.535260 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed496b1d6fc2da995dc6aa464aec539.slice/crio-bbd55035136f7c760dea830c8c0c409ca3b623408b2505f9f3d41ef084775b9e WatchSource:0}: Error finding container bbd55035136f7c760dea830c8c0c409ca3b623408b2505f9f3d41ef084775b9e: Status 404 returned error can't find the container with id bbd55035136f7c760dea830c8c0c409ca3b623408b2505f9f3d41ef084775b9e Jul 09 22:27:55.536978 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.536963 2552 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 22:27:55.543129 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:55.543105 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:27:55.549981 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:55.549960 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e1f116d5815810e312bf19af51fd4f.slice/crio-e2ff586ae4202cdf7855277c1f7b7a8b72c078f4053454ab9e9492e627de8dd4 WatchSource:0}: Error finding container e2ff586ae4202cdf7855277c1f7b7a8b72c078f4053454ab9e9492e627de8dd4: Status 404 returned error can't find the container with id e2ff586ae4202cdf7855277c1f7b7a8b72c078f4053454ab9e9492e627de8dd4 Jul 09 22:27:56.371640 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.371611 2552 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 22:27:56.389217 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.389195 2552 apiserver.go:52] "Watching apiserver" Jul 09 22:27:56.400600 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.400576 2552 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 22:27:56.401087 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.401063 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-9knp5","openshift-dns/node-resolver-82w6l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal","openshift-multus/multus-additional-cni-plugins-cffd4","openshift-network-operator/iptables-alerter-zx2tl","openshift-ovn-kubernetes/ovnkube-node-wpx72","kube-system/global-pull-secret-syncer-fnlb7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q","openshift-image-registry/node-ca-56fpj","openshift-multus/multus-25jwc","openshift-multus/network-metrics-daemon-5d8hc","openshift-network-diagnostics/network-check-target-tntl4","kube-system/konnectivity-agent-bwzsp","kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal"] Jul 09 22:27:56.403839 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.403815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.406142 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.406116 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.407238 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.407018 2552 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 22:27:56.408505 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.408485 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 22:27:56.409024 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.408776 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.409163 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.409147 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 22:27:56.409268 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.409247 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m9lwv\"" Jul 09 22:27:56.409481 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.409459 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 22:27:56.409585 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.409461 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.409905 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.409734 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 22:27:56.410329 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.410314 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 22:27:56.410567 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.410552 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 22:27:56.411782 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.411256 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.414035 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.414017 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.414132 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.414107 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:27:56.416336 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.416315 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.417881 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.417858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-run\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.417993 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.417896 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-kubelet\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.417993 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.417921 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-systemd-units\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.417993 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.417945 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-var-lib-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.417993 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.417972 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-etc-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.417996 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-cni-netd\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418020 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovn-node-metrics-cert\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418106 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-systemd\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418131 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysctl-conf\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418152 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-host\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418177 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc2zt\" (UniqueName: \"kubernetes.io/projected/ece4c6ea-cd40-49bc-b6f6-696044e5d595-kube-api-access-sc2zt\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.418231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418213 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-ovn\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418234 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-cni-bin\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418258 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovnkube-script-lib\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418295 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/474dae2e-6f22-4fed-b9a3-38924f38e576-agent-certs\") pod \"konnectivity-agent-bwzsp\" (UID: \"474dae2e-6f22-4fed-b9a3-38924f38e576\") " pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418318 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-kubernetes\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418359 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-lib-modules\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418419 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-slash\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418444 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-run-netns\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418469 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysconfig\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418509 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418547 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.418562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418572 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcw7r\" (UniqueName: \"kubernetes.io/projected/2828a1b3-cc74-4852-be04-87dbc797f6b9-kube-api-access-vcw7r\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418595 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-modprobe-d\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418661 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysctl-d\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418685 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece4c6ea-cd40-49bc-b6f6-696044e5d595-tmp\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418691 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5v8bn\"" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418710 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-env-overrides\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418748 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418977 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.418749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/474dae2e-6f22-4fed-b9a3-38924f38e576-konnectivity-ca\") pod \"konnectivity-agent-bwzsp\" (UID: \"474dae2e-6f22-4fed-b9a3-38924f38e576\") " pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419052 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-systemd\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419076 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-var-lib-kubelet\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419119 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-tuned\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419157 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-node-log\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419188 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-log-socket\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419205 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2wdpx\"" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419272 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-sys\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419296 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovnkube-config\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419553 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 22:27:56.419599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419566 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.420021 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419608 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 22:27:56.420021 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.419847 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.420121 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.420035 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 22:27:56.420282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.420246 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.420513 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.420494 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.422687 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.422670 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.426051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.425907 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.426051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.425998 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 22:27:56.426051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.426020 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.427908 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.427055 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 22:27:56.427908 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.426569 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.427908 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.426700 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.428283 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.428263 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t29ff\"" Jul 09 22:27:56.428773 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.428754 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.429295 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.429274 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-swmmf\"" Jul 09 22:27:56.429383 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.426870 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.429864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.429616 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 22:27:56.429864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.429636 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8hld5\"" Jul 09 22:27:56.430051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.429894 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-n4lbj\"" Jul 09 22:27:56.431219 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.431199 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.431594 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.431572 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:56.431698 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.431669 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:27:56.435432 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.435395 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:56.435517 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.435461 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:27:56.435668 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.435651 2552 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 22:27:56.437070 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.437051 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 22:27:56.437194 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.437088 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9tfmq\"" Jul 09 22:27:56.439046 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.439023 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.442603 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.442583 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kpvzk\"" Jul 09 22:27:56.442813 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.442794 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 22:27:56.443054 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.443033 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 22:27:56.502394 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.502369 2552 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5bsg" Jul 09 22:27:56.508425 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.508408 2552 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 22:27:56.519882 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.519857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbcmc\" (UniqueName: \"kubernetes.io/projected/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-kube-api-access-tbcmc\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.519969 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.519895 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2327c414-5cc3-446b-8261-3c87acd3ea07-dbus\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.519969 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.519926 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-systemd\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520044 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.519971 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-host\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520044 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520032 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-systemd\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520118 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520049 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc2zt\" (UniqueName: \"kubernetes.io/projected/ece4c6ea-cd40-49bc-b6f6-696044e5d595-kube-api-access-sc2zt\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520118 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520086 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-host\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520118 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520083 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-ovn\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520258 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520120 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovnkube-script-lib\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520258 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520146 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/474dae2e-6f22-4fed-b9a3-38924f38e576-agent-certs\") pod \"konnectivity-agent-bwzsp\" (UID: \"474dae2e-6f22-4fed-b9a3-38924f38e576\") " pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.520258 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520122 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-ovn\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520258 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520187 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-kubernetes\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520258 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520218 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-lib-modules\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520348 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-lib-modules\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520407 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-kubernetes\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520436 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-run-netns\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520465 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.520587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520503 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:56.520587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520529 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-iptables-alerter-script\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.520587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520553 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-device-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.520587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520559 2552 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520598 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysconfig\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520627 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcw7r\" (UniqueName: \"kubernetes.io/projected/2828a1b3-cc74-4852-be04-87dbc797f6b9-kube-api-access-vcw7r\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520657 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520684 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-run-netns\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520684 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-modprobe-d\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520764 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysconfig\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.520791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520788 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-modprobe-d\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520795 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovnkube-script-lib\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520857 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-conf-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520880 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-etc-kubernetes\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520911 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-tuned\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520941 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-node-log\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.520998 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-log-socket\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521024 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-os-release\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521002 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-node-log\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521035 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-log-socket\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521046 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-socket-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521085 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521114 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-sys\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521134 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521157 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovnkube-config\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521224 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521177 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-systemd-units\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521221 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-var-lib-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521256 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-sys\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521294 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovn-node-metrics-cert\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521295 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-systemd-units\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521316 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-var-lib-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521344 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7x9j\" (UniqueName: \"kubernetes.io/projected/7540a706-475e-457e-a0c7-3fcc142e8ea6-kube-api-access-d7x9j\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521384 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-sys-fs\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521417 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysctl-conf\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521443 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-cni-bin\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521465 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-serviceca\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521510 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521521 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-cni-bin\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521535 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-cnibin\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521559 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-hostroot\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521602 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-slash\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521624 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-os-release\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.521994 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521642 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysctl-conf\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521647 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f783638e-fe2e-4fa8-8076-fe55328cc59e-cni-binary-copy\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521672 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-k8s-cni-cncf-io\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521697 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-kubelet\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521726 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445mz\" (UniqueName: \"kubernetes.io/projected/f783638e-fe2e-4fa8-8076-fe55328cc59e-kube-api-access-445mz\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521763 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521805 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-slash\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521801 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521796 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovnkube-config\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521850 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-run-ovn-kubernetes\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521864 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521901 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-run-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521904 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysctl-d\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.521934 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece4c6ea-cd40-49bc-b6f6-696044e5d595-tmp\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522014 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-env-overrides\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522043 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-system-cni-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522069 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-netns\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.522844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522102 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7x9b\" (UniqueName: \"kubernetes.io/projected/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-kube-api-access-p7x9b\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522135 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/474dae2e-6f22-4fed-b9a3-38924f38e576-konnectivity-ca\") pod \"konnectivity-agent-bwzsp\" (UID: \"474dae2e-6f22-4fed-b9a3-38924f38e576\") " pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522193 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-systemd\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522219 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-var-lib-kubelet\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522254 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522043 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-sysctl-d\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522282 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-host\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522323 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cnibin\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522340 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522348 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-cni-bin\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522349 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-systemd\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522384 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-var-lib-kubelet\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522443 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-host-slash\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522477 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2327c414-5cc3-446b-8261-3c87acd3ea07-kubelet-config\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522499 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2828a1b3-cc74-4852-be04-87dbc797f6b9-env-overrides\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522510 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522550 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-cni-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.523685 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522589 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-cni-multus\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522666 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-daemon-config\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522731 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-multus-certs\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522772 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2693927f-4336-4752-8680-9328d861683a-hosts-file\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522818 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpp4\" (UniqueName: \"kubernetes.io/projected/2693927f-4336-4752-8680-9328d861683a-kube-api-access-jwpp4\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522850 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75rxk\" (UniqueName: \"kubernetes.io/projected/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-kube-api-access-75rxk\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522875 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2693927f-4336-4752-8680-9328d861683a-tmp-dir\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522903 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pssr2\" (UniqueName: \"kubernetes.io/projected/79933bc1-a97f-44d6-855f-005f42ff25f3-kube-api-access-pssr2\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522946 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-run\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522961 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/474dae2e-6f22-4fed-b9a3-38924f38e576-konnectivity-ca\") pod \"konnectivity-agent-bwzsp\" (UID: \"474dae2e-6f22-4fed-b9a3-38924f38e576\") " pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.522989 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-kubelet\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523040 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-kubelet\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523044 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-etc-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ece4c6ea-cd40-49bc-b6f6-696044e5d595-run\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523081 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-cni-netd\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523087 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-etc-openvswitch\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523121 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-socket-dir-parent\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.524573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523157 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2828a1b3-cc74-4852-be04-87dbc797f6b9-host-cni-netd\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.525373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523208 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-registration-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.525373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.523236 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.525373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.524761 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ece4c6ea-cd40-49bc-b6f6-696044e5d595-etc-tuned\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.525373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.525091 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/474dae2e-6f22-4fed-b9a3-38924f38e576-agent-certs\") pod \"konnectivity-agent-bwzsp\" (UID: \"474dae2e-6f22-4fed-b9a3-38924f38e576\") " pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.525373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.525196 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ece4c6ea-cd40-49bc-b6f6-696044e5d595-tmp\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.525373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.525300 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2828a1b3-cc74-4852-be04-87dbc797f6b9-ovn-node-metrics-cert\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.536107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.536086 2552 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-h5bsg" Jul 09 22:27:56.541222 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.541161 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" event={"ID":"40e1f116d5815810e312bf19af51fd4f","Type":"ContainerStarted","Data":"e2ff586ae4202cdf7855277c1f7b7a8b72c078f4053454ab9e9492e627de8dd4"} Jul 09 22:27:56.542321 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.542296 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" event={"ID":"1ed496b1d6fc2da995dc6aa464aec539","Type":"ContainerStarted","Data":"bbd55035136f7c760dea830c8c0c409ca3b623408b2505f9f3d41ef084775b9e"} Jul 09 22:27:56.547718 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.547692 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc2zt\" (UniqueName: \"kubernetes.io/projected/ece4c6ea-cd40-49bc-b6f6-696044e5d595-kube-api-access-sc2zt\") pod \"tuned-9knp5\" (UID: \"ece4c6ea-cd40-49bc-b6f6-696044e5d595\") " pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.549236 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.549215 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcw7r\" (UniqueName: \"kubernetes.io/projected/2828a1b3-cc74-4852-be04-87dbc797f6b9-kube-api-access-vcw7r\") pod \"ovnkube-node-wpx72\" (UID: \"2828a1b3-cc74-4852-be04-87dbc797f6b9\") " pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.623766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.623697 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.623766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.623742 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:56.623939 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.623792 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-iptables-alerter-script\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624210 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-device-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624257 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624293 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-conf-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624348 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-etc-kubernetes\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624379 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-os-release\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624404 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-socket-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624422 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624433 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624462 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624465 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-iptables-alerter-script\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624494 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7x9j\" (UniqueName: \"kubernetes.io/projected/7540a706-475e-457e-a0c7-3fcc142e8ea6-kube-api-access-d7x9j\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624506 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-device-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624519 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-sys-fs\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624547 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-serviceca\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624551 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-os-release\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.624901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624572 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624595 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-etc-selinux\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624597 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-cnibin\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624609 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-socket-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624640 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-hostroot\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.624645 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624668 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-sys-fs\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624682 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-hostroot\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.624712 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:27:57.124686542 +0000 UTC m=+3.023469351 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-system-cni-dir\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624644 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-cnibin\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624763 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-conf-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624827 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624864 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-etc-kubernetes\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624894 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-os-release\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f783638e-fe2e-4fa8-8076-fe55328cc59e-cni-binary-copy\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624993 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-k8s-cni-cncf-io\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.625854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.624999 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-os-release\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625020 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-kubelet\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625050 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445mz\" (UniqueName: \"kubernetes.io/projected/f783638e-fe2e-4fa8-8076-fe55328cc59e-kube-api-access-445mz\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625070 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-serviceca\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625082 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625120 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-system-cni-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625145 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625150 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-netns\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625178 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7x9b\" (UniqueName: \"kubernetes.io/projected/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-kube-api-access-p7x9b\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625196 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-kubelet\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625212 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-host\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625261 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cnibin\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625261 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-k8s-cni-cncf-io\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625318 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-netns\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625320 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cni-binary-copy\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625353 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-cni-bin\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625382 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-host-slash\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625408 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-host\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.626716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625408 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2327c414-5cc3-446b-8261-3c87acd3ea07-kubelet-config\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625437 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-cnibin\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625452 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2327c414-5cc3-446b-8261-3c87acd3ea07-kubelet-config\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625447 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625490 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-cni-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625509 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-system-cni-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.625527 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625534 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-host-slash\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625552 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-cni-bin\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625556 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f783638e-fe2e-4fa8-8076-fe55328cc59e-cni-binary-copy\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625564 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-cni-multus\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.625586 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:27:57.125568436 +0000 UTC m=+3.024351264 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625601 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-var-lib-cni-multus\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625616 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-daemon-config\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625625 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-cni-dir\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625634 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-multus-certs\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625656 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2693927f-4336-4752-8680-9328d861683a-hosts-file\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625696 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-host-run-multus-certs\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.627583 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625706 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2693927f-4336-4752-8680-9328d861683a-hosts-file\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625705 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpp4\" (UniqueName: \"kubernetes.io/projected/2693927f-4336-4752-8680-9328d861683a-kube-api-access-jwpp4\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625743 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75rxk\" (UniqueName: \"kubernetes.io/projected/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-kube-api-access-75rxk\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625768 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2693927f-4336-4752-8680-9328d861683a-tmp-dir\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625793 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pssr2\" (UniqueName: \"kubernetes.io/projected/79933bc1-a97f-44d6-855f-005f42ff25f3-kube-api-access-pssr2\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625825 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-socket-dir-parent\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625851 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-registration-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625879 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625904 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbcmc\" (UniqueName: \"kubernetes.io/projected/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-kube-api-access-tbcmc\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.625928 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2327c414-5cc3-446b-8261-3c87acd3ea07-dbus\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.626072 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2327c414-5cc3-446b-8261-3c87acd3ea07-dbus\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.626169 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-socket-dir-parent\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.626224 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/79933bc1-a97f-44d6-855f-005f42ff25f3-registration-dir\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.626221 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f783638e-fe2e-4fa8-8076-fe55328cc59e-multus-daemon-config\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.626393 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.628354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.626442 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2693927f-4336-4752-8680-9328d861683a-tmp-dir\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.647820 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.647789 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:27:56.647820 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.647815 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:27:56.647820 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.647828 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:27:56.648036 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:56.647891 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:27:57.147874484 +0000 UTC m=+3.046657291 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:27:56.660641 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.660617 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75rxk\" (UniqueName: \"kubernetes.io/projected/3a2d66cc-9134-4c96-bb3c-df4a05c605fb-kube-api-access-75rxk\") pod \"node-ca-56fpj\" (UID: \"3a2d66cc-9134-4c96-bb3c-df4a05c605fb\") " pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.667914 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.667885 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7x9b\" (UniqueName: \"kubernetes.io/projected/5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94-kube-api-access-p7x9b\") pod \"iptables-alerter-zx2tl\" (UID: \"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94\") " pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.668776 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.668748 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpp4\" (UniqueName: \"kubernetes.io/projected/2693927f-4336-4752-8680-9328d861683a-kube-api-access-jwpp4\") pod \"node-resolver-82w6l\" (UID: \"2693927f-4336-4752-8680-9328d861683a\") " pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:56.670105 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.670081 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-445mz\" (UniqueName: \"kubernetes.io/projected/f783638e-fe2e-4fa8-8076-fe55328cc59e-kube-api-access-445mz\") pod \"multus-25jwc\" (UID: \"f783638e-fe2e-4fa8-8076-fe55328cc59e\") " pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.670325 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.670303 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7x9j\" (UniqueName: \"kubernetes.io/projected/7540a706-475e-457e-a0c7-3fcc142e8ea6-kube-api-access-d7x9j\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:56.670656 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.670636 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pssr2\" (UniqueName: \"kubernetes.io/projected/79933bc1-a97f-44d6-855f-005f42ff25f3-kube-api-access-pssr2\") pod \"aws-ebs-csi-driver-node-2bs2q\" (UID: \"79933bc1-a97f-44d6-855f-005f42ff25f3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.671971 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.671952 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbcmc\" (UniqueName: \"kubernetes.io/projected/87bd8a1f-a844-4a10-bd8d-70a9852a7bd5-kube-api-access-tbcmc\") pod \"multus-additional-cni-plugins-cffd4\" (UID: \"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5\") " pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.716774 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.716751 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:27:56.726423 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.726402 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:27:56.739690 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.739666 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9knp5" Jul 09 22:27:56.746307 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.746285 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cffd4" Jul 09 22:27:56.755092 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.755064 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-zx2tl" Jul 09 22:27:56.763894 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.763869 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" Jul 09 22:27:56.770821 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.770803 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-56fpj" Jul 09 22:27:56.777670 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.777654 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-25jwc" Jul 09 22:27:56.783212 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:56.783195 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-82w6l" Jul 09 22:27:57.130544 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:57.130510 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:57.130544 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.130555 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:27:57.130781 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:57.130610 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:57.130781 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.130623 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:27:58.130602575 +0000 UTC m=+4.029385383 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:27:57.130781 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.130706 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:27:57.130781 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.130765 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:27:58.130748721 +0000 UTC m=+4.029531531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:27:57.231635 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:57.231598 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:57.231794 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.231773 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:27:57.231862 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.231800 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:27:57.231862 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.231815 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:27:57.231957 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.231879 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:27:58.231859252 +0000 UTC m=+4.130642064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:27:57.537673 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:57.537604 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:57.538201 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:57.537714 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:27:57.540752 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:57.540719 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:22:56 +0000 UTC" deadline="2028-02-12 12:29:34.724423347 +0000 UTC" Jul 09 22:27:57.540857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:57.540754 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13982h1m37.183674406s" Jul 09 22:27:57.688280 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.688255 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a2d66cc_9134_4c96_bb3c_df4a05c605fb.slice/crio-b514cf9eb068fed5a071cf8d9eb420d0b713cc4a444878a5233f6253d8e91ac0 WatchSource:0}: Error finding container b514cf9eb068fed5a071cf8d9eb420d0b713cc4a444878a5233f6253d8e91ac0: Status 404 returned error can't find the container with id b514cf9eb068fed5a071cf8d9eb420d0b713cc4a444878a5233f6253d8e91ac0 Jul 09 22:27:57.695326 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.695284 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79933bc1_a97f_44d6_855f_005f42ff25f3.slice/crio-891df25467d540c974f216cebfc00213bafd17fe009ed6621b1ad824271610aa WatchSource:0}: Error finding container 891df25467d540c974f216cebfc00213bafd17fe009ed6621b1ad824271610aa: Status 404 returned error can't find the container with id 891df25467d540c974f216cebfc00213bafd17fe009ed6621b1ad824271610aa Jul 09 22:27:57.696291 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.696268 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87bd8a1f_a844_4a10_bd8d_70a9852a7bd5.slice/crio-b32f2ddf802187e5fdadd7868ac40e8f17fb4e26725593bbc7e5f4e58f505e0b WatchSource:0}: Error finding container b32f2ddf802187e5fdadd7868ac40e8f17fb4e26725593bbc7e5f4e58f505e0b: Status 404 returned error can't find the container with id b32f2ddf802187e5fdadd7868ac40e8f17fb4e26725593bbc7e5f4e58f505e0b Jul 09 22:27:57.697575 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.697351 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b2aceb8_e4f4_48f9_b5d6_04d9ba279c94.slice/crio-3724fe87d44be3b2da94d43ec68646014967710978a4bdfcae683f9c09a97cec WatchSource:0}: Error finding container 3724fe87d44be3b2da94d43ec68646014967710978a4bdfcae683f9c09a97cec: Status 404 returned error can't find the container with id 3724fe87d44be3b2da94d43ec68646014967710978a4bdfcae683f9c09a97cec Jul 09 22:27:57.698436 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.698412 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2693927f_4336_4752_8680_9328d861683a.slice/crio-dd19dd66164d21e128b32f64c03c99f5c582669e3a90678efd9ca8dfdf79b463 WatchSource:0}: Error finding container dd19dd66164d21e128b32f64c03c99f5c582669e3a90678efd9ca8dfdf79b463: Status 404 returned error can't find the container with id dd19dd66164d21e128b32f64c03c99f5c582669e3a90678efd9ca8dfdf79b463 Jul 09 22:27:57.700070 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.699917 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod474dae2e_6f22_4fed_b9a3_38924f38e576.slice/crio-b85f15cbf418d5601806b206c30edfc8f7b97383c522533fdaf6464a0375db6c WatchSource:0}: Error finding container b85f15cbf418d5601806b206c30edfc8f7b97383c522533fdaf6464a0375db6c: Status 404 returned error can't find the container with id b85f15cbf418d5601806b206c30edfc8f7b97383c522533fdaf6464a0375db6c Jul 09 22:27:57.700964 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.700942 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece4c6ea_cd40_49bc_b6f6_696044e5d595.slice/crio-60e33b3368a7c9cbb99c6c8ad4e8298d8888d316d5914d6fdd2f0d0a0048e970 WatchSource:0}: Error finding container 60e33b3368a7c9cbb99c6c8ad4e8298d8888d316d5914d6fdd2f0d0a0048e970: Status 404 returned error can't find the container with id 60e33b3368a7c9cbb99c6c8ad4e8298d8888d316d5914d6fdd2f0d0a0048e970 Jul 09 22:27:57.702330 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.702264 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2828a1b3_cc74_4852_be04_87dbc797f6b9.slice/crio-152e86046919aa0b2ef182c1e568e735aeb6f9c7aba1accc7ee5b5c69c42c679 WatchSource:0}: Error finding container 152e86046919aa0b2ef182c1e568e735aeb6f9c7aba1accc7ee5b5c69c42c679: Status 404 returned error can't find the container with id 152e86046919aa0b2ef182c1e568e735aeb6f9c7aba1accc7ee5b5c69c42c679 Jul 09 22:27:57.703255 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:27:57.703232 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf783638e_fe2e_4fa8_8076_fe55328cc59e.slice/crio-204c528578e9e0ed3cb42875ee6e63b7dcefa091da6ed8620a2150d7b4cbdac0 WatchSource:0}: Error finding container 204c528578e9e0ed3cb42875ee6e63b7dcefa091da6ed8620a2150d7b4cbdac0: Status 404 returned error can't find the container with id 204c528578e9e0ed3cb42875ee6e63b7dcefa091da6ed8620a2150d7b4cbdac0 Jul 09 22:27:58.139898 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.139659 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:58.140165 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.139935 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:58.140165 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.139834 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:27:58.140165 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.140061 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:27:58.140165 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.140065 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:00.140040087 +0000 UTC m=+6.038822919 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:27:58.140165 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.140106 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:00.140089721 +0000 UTC m=+6.038872529 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:27:58.240812 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.240710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:58.240974 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.240946 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:27:58.240974 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.240968 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:27:58.241098 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.240982 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:27:58.241098 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.241045 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:00.241025717 +0000 UTC m=+6.139808550 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:27:58.541293 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.540414 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:27:58.541293 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.540557 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:27:58.541293 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.540974 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:27:58.541293 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:58.541077 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:27:58.541293 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.541161 2552 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 22:22:56 +0000 UTC" deadline="2028-01-19 15:36:18.630692641 +0000 UTC" Jul 09 22:27:58.541293 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.541201 2552 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13409h8m20.089494894s" Jul 09 22:27:58.560833 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.560806 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" event={"ID":"40e1f116d5815810e312bf19af51fd4f","Type":"ContainerStarted","Data":"ea94a8ec0607efdd4d4a2bb32f98ce6b504d92c4b9e64831bd9e41a84580691a"} Jul 09 22:27:58.581767 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.581732 2552 generic.go:356] "Generic (PLEG): container finished" podID="1ed496b1d6fc2da995dc6aa464aec539" containerID="513d8ae757d14125b16cd1a864fdc284d40f1826accb64c856af7f5fd86a7f37" exitCode=0 Jul 09 22:27:58.581911 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.581820 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" event={"ID":"1ed496b1d6fc2da995dc6aa464aec539","Type":"ContainerDied","Data":"513d8ae757d14125b16cd1a864fdc284d40f1826accb64c856af7f5fd86a7f37"} Jul 09 22:27:58.592584 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.592553 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-25jwc" event={"ID":"f783638e-fe2e-4fa8-8076-fe55328cc59e","Type":"ContainerStarted","Data":"204c528578e9e0ed3cb42875ee6e63b7dcefa091da6ed8620a2150d7b4cbdac0"} Jul 09 22:27:58.604529 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.604055 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-240.ec2.internal" podStartSLOduration=3.6040367 podStartE2EDuration="3.6040367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:27:58.582454934 +0000 UTC m=+4.481237769" watchObservedRunningTime="2026-07-09 22:27:58.6040367 +0000 UTC m=+4.502819535" Jul 09 22:27:58.613531 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.613419 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"152e86046919aa0b2ef182c1e568e735aeb6f9c7aba1accc7ee5b5c69c42c679"} Jul 09 22:27:58.618654 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.618628 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwzsp" event={"ID":"474dae2e-6f22-4fed-b9a3-38924f38e576","Type":"ContainerStarted","Data":"b85f15cbf418d5601806b206c30edfc8f7b97383c522533fdaf6464a0375db6c"} Jul 09 22:27:58.631216 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.631184 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-82w6l" event={"ID":"2693927f-4336-4752-8680-9328d861683a","Type":"ContainerStarted","Data":"dd19dd66164d21e128b32f64c03c99f5c582669e3a90678efd9ca8dfdf79b463"} Jul 09 22:27:58.644641 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.644567 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerStarted","Data":"b32f2ddf802187e5fdadd7868ac40e8f17fb4e26725593bbc7e5f4e58f505e0b"} Jul 09 22:27:58.682429 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.682396 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" event={"ID":"79933bc1-a97f-44d6-855f-005f42ff25f3","Type":"ContainerStarted","Data":"891df25467d540c974f216cebfc00213bafd17fe009ed6621b1ad824271610aa"} Jul 09 22:27:58.701912 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.701880 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9knp5" event={"ID":"ece4c6ea-cd40-49bc-b6f6-696044e5d595","Type":"ContainerStarted","Data":"60e33b3368a7c9cbb99c6c8ad4e8298d8888d316d5914d6fdd2f0d0a0048e970"} Jul 09 22:27:58.708223 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.708198 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zx2tl" event={"ID":"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94","Type":"ContainerStarted","Data":"3724fe87d44be3b2da94d43ec68646014967710978a4bdfcae683f9c09a97cec"} Jul 09 22:27:58.710765 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:58.710738 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-56fpj" event={"ID":"3a2d66cc-9134-4c96-bb3c-df4a05c605fb","Type":"ContainerStarted","Data":"b514cf9eb068fed5a071cf8d9eb420d0b713cc4a444878a5233f6253d8e91ac0"} Jul 09 22:27:59.538622 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:59.538122 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:27:59.538622 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:27:59.538265 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:27:59.731322 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:59.730934 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" event={"ID":"1ed496b1d6fc2da995dc6aa464aec539","Type":"ContainerStarted","Data":"2400f655a2b8774b4540d9d11427388fdf79846040c28a2299d1c2c58afe8c5f"} Jul 09 22:27:59.757822 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:27:59.757757 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-240.ec2.internal" podStartSLOduration=4.757736831 podStartE2EDuration="4.757736831s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:27:59.757379596 +0000 UTC m=+5.656162443" watchObservedRunningTime="2026-07-09 22:27:59.757736831 +0000 UTC m=+5.656519662" Jul 09 22:28:00.158198 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:00.158144 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:00.158382 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:00.158243 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:00.158382 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.158374 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:00.158490 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.158432 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:04.158415732 +0000 UTC m=+10.057198541 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:00.158852 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.158787 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:00.158852 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.158834 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:04.158819991 +0000 UTC m=+10.057602802 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:00.259610 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:00.259570 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:00.259772 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.259755 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:00.259772 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.259773 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:00.259883 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.259785 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:00.259883 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.259854 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:04.259836629 +0000 UTC m=+10.158619435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:00.538338 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:00.538265 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:00.538502 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.538404 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:00.538502 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:00.538454 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:00.538619 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:00.538591 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:01.538171 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:01.538126 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:01.538660 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:01.538270 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:02.538986 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:02.538954 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:02.539418 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:02.539084 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:02.539646 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:02.539558 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:02.539742 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:02.539659 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:03.537839 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:03.537790 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:03.538055 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:03.537926 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:04.192985 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:04.192946 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:04.193664 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:04.193035 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:04.193664 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.193148 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:04.193664 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.193245 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:12.193222096 +0000 UTC m=+18.092004904 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:04.193664 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.193148 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:04.193664 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.193315 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:12.193296116 +0000 UTC m=+18.092078937 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:04.293789 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:04.293755 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:04.293968 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.293946 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:04.294050 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.293976 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:04.294050 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.293989 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:04.294146 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.294058 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:12.294038037 +0000 UTC m=+18.192820871 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:04.542385 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:04.541919 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:04.542385 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.542066 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:04.542385 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:04.542211 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:04.542681 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:04.542425 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:05.537846 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:05.537762 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:05.538301 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:05.537892 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:06.537802 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:06.537770 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:06.537973 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:06.537908 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:06.538360 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:06.538339 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:06.538477 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:06.538440 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:07.537945 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:07.537779 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:07.537945 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:07.537902 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:08.537996 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:08.537962 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:08.538188 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:08.538121 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:08.538553 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:08.538216 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:08.538553 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:08.538310 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:08.750969 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:08.750930 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-bwzsp" event={"ID":"474dae2e-6f22-4fed-b9a3-38924f38e576","Type":"ContainerStarted","Data":"1699b3e1a94d2c6130a9ec7f56878b032a4d5712ba2034661b503b01f8455ccf"} Jul 09 22:28:08.772676 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:08.772623 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-bwzsp" podStartSLOduration=4.686020536 podStartE2EDuration="14.77260644s" totalImagesPullingTime="10.086585904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:08.771900767 +0000 UTC m=+14.670683594" watchObservedRunningTime="2026-07-09 22:28:08.77260644 +0000 UTC m=+14.671389266" Jul 09 22:28:09.537965 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:09.537929 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:09.538118 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:09.538061 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:10.537955 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:10.537921 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:10.538403 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:10.538056 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:10.538403 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:10.538128 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:10.538403 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:10.538237 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:11.537305 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:11.537270 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:11.537536 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:11.537378 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:11.809874 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:11.809813 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:28:12.252270 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:12.252233 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:12.252457 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:12.252315 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:12.252457 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.252383 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:12.252457 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.252413 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:12.252457 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.252456 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:28.252436071 +0000 UTC m=+34.151218877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:12.252655 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.252475 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:28.252466934 +0000 UTC m=+34.151249741 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:12.353050 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:12.352988 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:12.353221 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.353178 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:12.353221 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.353200 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:12.353221 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.353210 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:12.353354 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.353266 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:28.353249652 +0000 UTC m=+34.252032469 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:12.537645 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:12.537566 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:12.537645 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:12.537597 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:12.537862 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.537708 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:12.537862 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:12.537809 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:13.180358 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:13.180315 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:28:13.180980 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:13.180936 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:28:13.537383 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:13.537288 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:13.537530 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:13.537425 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:13.760181 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:13.760143 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-bwzsp" Jul 09 22:28:14.538106 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:14.538075 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:14.538551 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:14.538191 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:14.538551 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:14.538210 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:14.538551 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:14.538318 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:15.537639 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:15.537606 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:15.537805 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:15.537741 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:16.538181 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.537867 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:16.538938 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.537917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:16.538938 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:16.538272 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:16.538938 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:16.538348 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:16.765962 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.765934 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-56fpj" event={"ID":"3a2d66cc-9134-4c96-bb3c-df4a05c605fb","Type":"ContainerStarted","Data":"ba84f0a14f306d81f6bf514424dbb083120c4d12950b557648cd6cb1c2cda0bb"} Jul 09 22:28:16.769879 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.769846 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-25jwc" event={"ID":"f783638e-fe2e-4fa8-8076-fe55328cc59e","Type":"ContainerStarted","Data":"911b58ac6d9411eb00c56530de134f691bf9dae85bf46671367ee7568cf6f3ac"} Jul 09 22:28:16.772588 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.772563 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"0b0412627878c902199aa9ddb4263b0870960035c1d8d9c8a7d2ba74f3c6a916"} Jul 09 22:28:16.772691 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.772625 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"6ae6259054614bf11856b07297c5bfe1f64c18d9db88f969647e6d71485ea7bb"} Jul 09 22:28:16.772691 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.772670 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"76e89995278e88ab43671083f01e45a4721e54262dd51893ff53d3bb0eafc578"} Jul 09 22:28:16.772780 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.772712 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"7f45d1104869266ae6df4c7940e92e6fc95111b2f100e74acdae43e3e283eea1"} Jul 09 22:28:16.772780 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.772746 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"027ff4d150355eca395f7fe2ec6ea5af2fe0eebbe0dce22a702de5de37e52f0a"} Jul 09 22:28:16.772847 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.772789 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"e4c7fd35c04d0b6a45f3b2c20ac18473fc6d7e07498b4398e3d2f5d023bdeb77"} Jul 09 22:28:16.773756 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.773735 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-82w6l" event={"ID":"2693927f-4336-4752-8680-9328d861683a","Type":"ContainerStarted","Data":"b94176fa8f1171b09df138170b8cd72e19b73d037637919ff1027d3333a2ce5e"} Jul 09 22:28:16.775025 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.775005 2552 generic.go:356] "Generic (PLEG): container finished" podID="87bd8a1f-a844-4a10-bd8d-70a9852a7bd5" containerID="cfff1fa50c5cb8af518f0df49f5585325745d10f0c820a47909241900f73815a" exitCode=0 Jul 09 22:28:16.775101 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.775067 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerDied","Data":"cfff1fa50c5cb8af518f0df49f5585325745d10f0c820a47909241900f73815a"} Jul 09 22:28:16.776446 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.776380 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" event={"ID":"79933bc1-a97f-44d6-855f-005f42ff25f3","Type":"ContainerStarted","Data":"29fc6daa99362d60b1b8a47f4325277d4a83865dba0e658b81bb811c395e5227"} Jul 09 22:28:16.777784 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.777767 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9knp5" event={"ID":"ece4c6ea-cd40-49bc-b6f6-696044e5d595","Type":"ContainerStarted","Data":"4d44fce1a13bebfcc5b5797bac032e7108ce7d08399f33d625c72201bb4da0b8"} Jul 09 22:28:16.786410 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.786378 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-56fpj" podStartSLOduration=11.667191209 podStartE2EDuration="21.786367869s" totalImagesPullingTime="10.11917666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:16.785624908 +0000 UTC m=+22.684407734" watchObservedRunningTime="2026-07-09 22:28:16.786367869 +0000 UTC m=+22.685150739" Jul 09 22:28:16.811170 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.811119 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-25jwc" podStartSLOduration=3.684692492 podStartE2EDuration="21.811107432s" totalImagesPullingTime="18.12641494s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:16.810945197 +0000 UTC m=+22.709728024" watchObservedRunningTime="2026-07-09 22:28:16.811107432 +0000 UTC m=+22.709890258" Jul 09 22:28:16.866173 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.866106 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9knp5" podStartSLOduration=4.785566193 podStartE2EDuration="22.866085303s" totalImagesPullingTime="18.08051911s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:16.866053548 +0000 UTC m=+22.764836376" watchObservedRunningTime="2026-07-09 22:28:16.866085303 +0000 UTC m=+22.764868132" Jul 09 22:28:16.866304 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:16.866260 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-82w6l" podStartSLOduration=11.756960844 podStartE2EDuration="21.866251793s" totalImagesPullingTime="10.109290949s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:16.834035617 +0000 UTC m=+22.732818443" watchObservedRunningTime="2026-07-09 22:28:16.866251793 +0000 UTC m=+22.765034620" Jul 09 22:28:17.429937 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.429904 2552 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 22:28:17.475506 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.475394 2552 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T22:28:17.429935292Z","UUID":"5226db2f-b7e9-4fdd-8a59-26421fd97b20","Handler":null,"Name":"","Endpoint":""} Jul 09 22:28:17.476934 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.476910 2552 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 22:28:17.477063 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.476950 2552 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 22:28:17.537752 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.537731 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:17.537865 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:17.537823 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:17.781092 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.781059 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" event={"ID":"79933bc1-a97f-44d6-855f-005f42ff25f3","Type":"ContainerStarted","Data":"6b6bd51a7157de738d15809ac4554535693f77598e116c0a1b6e76a5e86737c0"} Jul 09 22:28:17.782471 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.782448 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-zx2tl" event={"ID":"5b2aceb8-e4f4-48f9-b5d6-04d9ba279c94","Type":"ContainerStarted","Data":"927edd86cd22344df66cf5ae0b216190fa15af93954572ff271ef583ce695fa6"} Jul 09 22:28:17.813719 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:17.813680 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-zx2tl" podStartSLOduration=12.699472082 podStartE2EDuration="22.81366651s" totalImagesPullingTime="10.114194428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:17.813488222 +0000 UTC m=+23.712271048" watchObservedRunningTime="2026-07-09 22:28:17.81366651 +0000 UTC m=+23.712449336" Jul 09 22:28:18.537886 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:18.537849 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:18.538059 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:18.537914 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:18.538059 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:18.537990 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:18.538201 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:18.538089 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:18.788020 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:18.787744 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"7ef7d82b0898a43c75da12328905fe7be90d8c54630c5a80139143ef0feabc3e"} Jul 09 22:28:19.537543 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:19.537508 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:19.537757 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:19.537621 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:19.791803 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:19.791724 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" event={"ID":"79933bc1-a97f-44d6-855f-005f42ff25f3","Type":"ContainerStarted","Data":"e9c35a54d4e3bbf89bfe6112088a678d742f9032c394080b08b22863584fc746"} Jul 09 22:28:19.824328 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:19.824285 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2bs2q" podStartSLOduration=11.990072868 podStartE2EDuration="24.82427034s" totalImagesPullingTime="12.834197472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:19.824025251 +0000 UTC m=+25.722808077" watchObservedRunningTime="2026-07-09 22:28:19.82427034 +0000 UTC m=+25.723053167" Jul 09 22:28:20.537760 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:20.537730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:20.537760 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:20.537746 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:20.537996 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:20.537838 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:20.537996 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:20.537985 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:20.797995 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:20.797957 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" event={"ID":"2828a1b3-cc74-4852-be04-87dbc797f6b9","Type":"ContainerStarted","Data":"ed8e881c297bbcc9998e83901ef3b8aeff99399b514b40243fa370af4d7d4cac"} Jul 09 22:28:21.538119 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.537917 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:21.538286 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:21.538215 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:21.800399 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.800321 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 22:28:21.800857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.800825 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:28:21.800964 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.800919 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:28:21.817321 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.817294 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:28:21.817609 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.817592 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:28:21.850779 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:21.850732 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" podStartSLOduration=9.702823863999999 podStartE2EDuration="27.850714993s" totalImagesPullingTime="18.147891129s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:20.831110233 +0000 UTC m=+26.729893061" watchObservedRunningTime="2026-07-09 22:28:21.850714993 +0000 UTC m=+27.749497827" Jul 09 22:28:22.537479 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.537272 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:22.537479 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:22.537414 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:22.537779 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.537699 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:22.537883 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:22.537813 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:22.802924 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.802891 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 22:28:22.976495 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.976439 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fnlb7"] Jul 09 22:28:22.977211 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.976569 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:22.977211 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:22.976663 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:22.978236 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.978211 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5d8hc"] Jul 09 22:28:22.978337 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.978320 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:22.978457 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:22.978421 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:22.978996 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.978971 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tntl4"] Jul 09 22:28:22.979102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:22.979059 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:22.979206 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:22.979145 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:23.809859 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:23.809680 2552 generic.go:356] "Generic (PLEG): container finished" podID="87bd8a1f-a844-4a10-bd8d-70a9852a7bd5" containerID="457e20b4a2757009d9547c6a2756c83e59ab273afbb220ec0055b68cb6f15500" exitCode=0 Jul 09 22:28:23.810354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:23.809768 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerDied","Data":"457e20b4a2757009d9547c6a2756c83e59ab273afbb220ec0055b68cb6f15500"} Jul 09 22:28:23.810354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:23.809953 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 22:28:24.389106 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.389062 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:24.538732 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.538703 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:24.538903 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:24.538785 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:24.538966 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.538901 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:24.539077 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:24.539051 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:24.539140 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.539076 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:24.539224 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:24.539154 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:24.568293 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.568261 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:24.866389 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.866362 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:24.968153 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:24.968091 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:25.417115 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:25.417086 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:28:25.417403 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:25.417382 2552 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 09 22:28:25.429378 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:25.429327 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" podUID="2828a1b3-cc74-4852-be04-87dbc797f6b9" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 22:28:25.437637 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:25.437612 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" podUID="2828a1b3-cc74-4852-be04-87dbc797f6b9" containerName="ovnkube-controller" probeResult="failure" output="" Jul 09 22:28:25.816040 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:25.815964 2552 generic.go:356] "Generic (PLEG): container finished" podID="87bd8a1f-a844-4a10-bd8d-70a9852a7bd5" containerID="48fb7b070d998f52e5430cd017b63bab86e0e332684ef9a23a1b3396d5185b37" exitCode=0 Jul 09 22:28:25.816040 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:25.816006 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerDied","Data":"48fb7b070d998f52e5430cd017b63bab86e0e332684ef9a23a1b3396d5185b37"} Jul 09 22:28:26.537492 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:26.537464 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:26.537492 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:26.537464 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:26.538195 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:26.537476 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:26.538195 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:26.537579 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:26.538195 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:26.537668 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:26.538195 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:26.537786 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:26.820019 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:26.819952 2552 generic.go:356] "Generic (PLEG): container finished" podID="87bd8a1f-a844-4a10-bd8d-70a9852a7bd5" containerID="5b6aa1db4701d1301faae7990bb3034b86da76fd6b7936077982630419f2ef86" exitCode=0 Jul 09 22:28:26.820019 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:26.819995 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerDied","Data":"5b6aa1db4701d1301faae7990bb3034b86da76fd6b7936077982630419f2ef86"} Jul 09 22:28:28.278288 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.278247 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:28.278830 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.278312 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:28.278830 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.278406 2552 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:28.278830 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.278407 2552 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:28.278830 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.278467 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs podName:7540a706-475e-457e-a0c7-3fcc142e8ea6 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:00.278451118 +0000 UTC m=+66.177233944 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs") pod "network-metrics-daemon-5d8hc" (UID: "7540a706-475e-457e-a0c7-3fcc142e8ea6") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 22:28:28.278830 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.278483 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret podName:2327c414-5cc3-446b-8261-3c87acd3ea07 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:00.278476016 +0000 UTC m=+66.177258821 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret") pod "global-pull-secret-syncer-fnlb7" (UID: "2327c414-5cc3-446b-8261-3c87acd3ea07") : object "kube-system"/"original-pull-secret" not registered Jul 09 22:28:28.379381 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.379342 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:28.379523 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.379454 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 22:28:28.379523 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.379474 2552 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 22:28:28.379523 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.379485 2552 projected.go:196] Error preparing data for projected volume kube-api-access-dgskd for pod openshift-network-diagnostics/network-check-target-tntl4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:28.379612 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.379526 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd podName:1e5289ee-610e-431f-b3f7-56cf0a9a6e9c nodeName:}" failed. No retries permitted until 2026-07-09 22:29:00.379514212 +0000 UTC m=+66.278297017 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dgskd" (UniqueName: "kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd") pod "network-check-target-tntl4" (UID: "1e5289ee-610e-431f-b3f7-56cf0a9a6e9c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 22:28:28.537248 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.537178 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:28.537248 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.537213 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:28.537421 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.537180 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:28.537421 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.537298 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fnlb7" podUID="2327c414-5cc3-446b-8261-3c87acd3ea07" Jul 09 22:28:28.537421 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.537358 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tntl4" podUID="1e5289ee-610e-431f-b3f7-56cf0a9a6e9c" Jul 09 22:28:28.537521 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:28.537418 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5d8hc" podUID="7540a706-475e-457e-a0c7-3fcc142e8ea6" Jul 09 22:28:28.542581 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.542554 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:28.656554 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.656528 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:28.768627 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.768596 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:28.877479 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.877439 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:28.974987 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:28.974957 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:29.439455 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.439425 2552 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-240.ec2.internal" event="NodeReady" Jul 09 22:28:29.439863 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.439547 2552 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 22:28:29.515650 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.515575 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-v9r9f"] Jul 09 22:28:29.519322 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.519302 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cx995"] Jul 09 22:28:29.519445 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.519429 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.522955 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.522938 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh"] Jul 09 22:28:29.523079 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.523047 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.523484 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.523468 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hnlbl\"" Jul 09 22:28:29.523562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.523468 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 22:28:29.525079 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.525064 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 22:28:29.526681 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.526665 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.529890 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.529875 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 22:28:29.529992 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.529893 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 22:28:29.529992 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.529908 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xf6cr\"" Jul 09 22:28:29.529992 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.529880 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 22:28:29.530764 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.530745 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 22:28:29.531220 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.531203 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 22:28:29.531324 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.531223 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 22:28:29.531324 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.531257 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-4tkdk\"" Jul 09 22:28:29.534901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.534884 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v9r9f"] Jul 09 22:28:29.537810 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.537790 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cx995"] Jul 09 22:28:29.537917 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.537898 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 22:28:29.555321 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.555301 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh"] Jul 09 22:28:29.643637 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.643615 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:29.686628 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686603 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-installation-pull-secrets\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.686737 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.686737 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686693 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-trusted-ca\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.686737 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686708 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/400fbc3c-86a2-4987-adf6-ad2fcbf2f96d-cert\") pod \"ingress-canary-cx995\" (UID: \"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d\") " pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.686873 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686749 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-bound-sa-token\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.686873 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-ca-trust-extracted\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.686873 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686796 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-image-registry-private-configuration\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.686873 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686828 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwphv\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-kube-api-access-kwphv\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.686873 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686849 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0986295-13f5-4f88-9029-b7a13917159c-config-volume\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.687108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686876 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.687108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686922 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-certificates\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.687108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.686999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0986295-13f5-4f88-9029-b7a13917159c-tmp-dir\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.687108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.687018 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fb49n\" (UniqueName: \"kubernetes.io/projected/e0986295-13f5-4f88-9029-b7a13917159c-kube-api-access-fb49n\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.687108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.687083 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wkh8\" (UniqueName: \"kubernetes.io/projected/400fbc3c-86a2-4987-adf6-ad2fcbf2f96d-kube-api-access-2wkh8\") pod \"ingress-canary-cx995\" (UID: \"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d\") " pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.744848 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.744812 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:29.787929 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.787867 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0986295-13f5-4f88-9029-b7a13917159c-config-volume\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.787929 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.787897 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.787929 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.787917 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-certificates\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.787940 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0986295-13f5-4f88-9029-b7a13917159c-tmp-dir\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.787965 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fb49n\" (UniqueName: \"kubernetes.io/projected/e0986295-13f5-4f88-9029-b7a13917159c-kube-api-access-fb49n\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788012 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wkh8\" (UniqueName: \"kubernetes.io/projected/400fbc3c-86a2-4987-adf6-ad2fcbf2f96d-kube-api-access-2wkh8\") pod \"ingress-canary-cx995\" (UID: \"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d\") " pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788038 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-installation-pull-secrets\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788061 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788108 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-trusted-ca\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788127 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/400fbc3c-86a2-4987-adf6-ad2fcbf2f96d-cert\") pod \"ingress-canary-cx995\" (UID: \"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d\") " pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.788467 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788175 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-bound-sa-token\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788467 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788202 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-ca-trust-extracted\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788467 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788231 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-image-registry-private-configuration\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788467 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788256 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwphv\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-kube-api-access-kwphv\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788649 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788517 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0986295-13f5-4f88-9029-b7a13917159c-tmp-dir\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.788649 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788558 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-certificates\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.788649 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:29.788039 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 22:28:29.788649 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.788585 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e0986295-13f5-4f88-9029-b7a13917159c-config-volume\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.788830 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:29.788599 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh: secret "image-registry-tls" not found Jul 09 22:28:29.788830 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:29.788735 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls podName:5ab47c69-5b3a-4daa-b3b9-1f42eac485cb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:30.288716279 +0000 UTC m=+36.187499101 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls") pod "image-registry-7dc5cc7f7f-t4qhh" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb") : secret "image-registry-tls" not found Jul 09 22:28:29.788920 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:29.788677 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 22:28:29.788957 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:29.788930 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls podName:e0986295-13f5-4f88-9029-b7a13917159c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:30.288916588 +0000 UTC m=+36.187699398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls") pod "dns-default-v9r9f" (UID: "e0986295-13f5-4f88-9029-b7a13917159c") : secret "dns-default-metrics-tls" not found Jul 09 22:28:29.789372 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.789214 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-ca-trust-extracted\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.789372 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.789315 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-trusted-ca\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.792639 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.792526 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-installation-pull-secrets\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.792714 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.792569 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-image-registry-private-configuration\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.792714 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.792602 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/400fbc3c-86a2-4987-adf6-ad2fcbf2f96d-cert\") pod \"ingress-canary-cx995\" (UID: \"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d\") " pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.798969 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.798951 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fb49n\" (UniqueName: \"kubernetes.io/projected/e0986295-13f5-4f88-9029-b7a13917159c-kube-api-access-fb49n\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:29.799065 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.799031 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wkh8\" (UniqueName: \"kubernetes.io/projected/400fbc3c-86a2-4987-adf6-ad2fcbf2f96d-kube-api-access-2wkh8\") pod \"ingress-canary-cx995\" (UID: \"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d\") " pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.799284 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.799270 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwphv\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-kube-api-access-kwphv\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.799341 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.799265 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-bound-sa-token\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:29.835367 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.835337 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cx995" Jul 09 22:28:29.851243 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.851220 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:29.982749 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:29.982719 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cx995"] Jul 09 22:28:30.293373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.293330 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:30.293577 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.293417 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:30.293577 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:30.293527 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 22:28:30.293577 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:30.293535 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 22:28:30.293577 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:30.293554 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh: secret "image-registry-tls" not found Jul 09 22:28:30.293741 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:30.293597 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls podName:e0986295-13f5-4f88-9029-b7a13917159c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:31.293576469 +0000 UTC m=+37.192359295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls") pod "dns-default-v9r9f" (UID: "e0986295-13f5-4f88-9029-b7a13917159c") : secret "dns-default-metrics-tls" not found Jul 09 22:28:30.293741 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:30.293615 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls podName:5ab47c69-5b3a-4daa-b3b9-1f42eac485cb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:31.293608497 +0000 UTC m=+37.192391306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls") pod "image-registry-7dc5cc7f7f-t4qhh" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb") : secret "image-registry-tls" not found Jul 09 22:28:30.541478 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.541405 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:28:30.541972 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.541525 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:28:30.541972 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.541618 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:28:30.546504 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.546444 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 22:28:30.546504 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.546461 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 22:28:30.546504 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.546449 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 22:28:30.546868 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.546848 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2swrh\"" Jul 09 22:28:30.546971 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.546898 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 22:28:30.547037 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.546858 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9x2j\"" Jul 09 22:28:30.553366 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:30.553332 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:31.301259 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:31.301224 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:31.301413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:31.301291 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:31.301413 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:31.301379 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 22:28:31.301413 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:31.301393 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 22:28:31.301413 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:31.301396 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh: secret "image-registry-tls" not found Jul 09 22:28:31.301598 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:31.301452 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls podName:5ab47c69-5b3a-4daa-b3b9-1f42eac485cb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:33.301437271 +0000 UTC m=+39.200220080 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls") pod "image-registry-7dc5cc7f7f-t4qhh" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb") : secret "image-registry-tls" not found Jul 09 22:28:31.301598 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:31.301470 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls podName:e0986295-13f5-4f88-9029-b7a13917159c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:33.301462056 +0000 UTC m=+39.200244862 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls") pod "dns-default-v9r9f" (UID: "e0986295-13f5-4f88-9029-b7a13917159c") : secret "dns-default-metrics-tls" not found Jul 09 22:28:31.437792 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:28:31.437756 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod400fbc3c_86a2_4987_adf6_ad2fcbf2f96d.slice/crio-ff63bf33f5ddfe1a93a6f6b96d1caff5250ab74e9bf2d42a8fb87ae4088db72c WatchSource:0}: Error finding container ff63bf33f5ddfe1a93a6f6b96d1caff5250ab74e9bf2d42a8fb87ae4088db72c: Status 404 returned error can't find the container with id ff63bf33f5ddfe1a93a6f6b96d1caff5250ab74e9bf2d42a8fb87ae4088db72c Jul 09 22:28:31.831122 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:31.830932 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cx995" event={"ID":"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d","Type":"ContainerStarted","Data":"ff63bf33f5ddfe1a93a6f6b96d1caff5250ab74e9bf2d42a8fb87ae4088db72c"} Jul 09 22:28:31.833636 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:31.833616 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerStarted","Data":"abe57a6315c66b506bbdfa4b44843c5462b38e4453fcd27f5a283c109bd662a9"} Jul 09 22:28:32.436051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:32.436004 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:32.549554 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:32.549521 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:32.838712 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:32.838683 2552 generic.go:356] "Generic (PLEG): container finished" podID="87bd8a1f-a844-4a10-bd8d-70a9852a7bd5" containerID="abe57a6315c66b506bbdfa4b44843c5462b38e4453fcd27f5a283c109bd662a9" exitCode=0 Jul 09 22:28:32.839051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:32.838754 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerDied","Data":"abe57a6315c66b506bbdfa4b44843c5462b38e4453fcd27f5a283c109bd662a9"} Jul 09 22:28:33.010199 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.010147 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:33.109630 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.109560 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:33.316742 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.316710 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:33.316905 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.316772 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:33.316905 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.316874 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 22:28:33.316905 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.316889 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 22:28:33.317032 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.316939 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls podName:e0986295-13f5-4f88-9029-b7a13917159c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:37.316925341 +0000 UTC m=+43.215708146 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls") pod "dns-default-v9r9f" (UID: "e0986295-13f5-4f88-9029-b7a13917159c") : secret "dns-default-metrics-tls" not found Jul 09 22:28:33.317032 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.316891 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh: secret "image-registry-tls" not found Jul 09 22:28:33.317032 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.317002 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls podName:5ab47c69-5b3a-4daa-b3b9-1f42eac485cb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:37.316990456 +0000 UTC m=+43.215773271 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls") pod "image-registry-7dc5cc7f7f-t4qhh" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb") : secret "image-registry-tls" not found Jul 09 22:28:33.550028 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.550000 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-t7qdq"] Jul 09 22:28:33.582107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.582077 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.585618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.585585 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7qdq"] Jul 09 22:28:33.591795 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.591770 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 22:28:33.591965 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.591885 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 22:28:33.593341 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.593302 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 22:28:33.593449 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.593377 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5vmj\"" Jul 09 22:28:33.593679 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.593660 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 22:28:33.621733 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.621699 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:33.711365 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.711322 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:33.719413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.719377 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.719556 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.719424 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-crio-socket\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.719627 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.719570 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-data-volume\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.719627 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.719606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.719733 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.719636 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xl7fl\" (UniqueName: \"kubernetes.io/projected/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-api-access-xl7fl\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.820777 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.820715 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-data-volume\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.820777 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.820747 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.820777 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.820764 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xl7fl\" (UniqueName: \"kubernetes.io/projected/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-api-access-xl7fl\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.821021 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.820817 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.821021 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.820846 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-crio-socket\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.821021 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.820884 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 22:28:33.821021 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.820932 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 22:28:33.821021 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.820952 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:34.32093161 +0000 UTC m=+40.219714417 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : secret "insights-runtime-extractor-tls" not found Jul 09 22:28:33.821021 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:33.821016 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:34.320997306 +0000 UTC m=+40.219780112 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : configmap "kube-rbac-proxy" not found Jul 09 22:28:33.821278 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.821048 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-crio-socket\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.821278 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.821064 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-data-volume\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.832793 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.832770 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:33.836065 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.836049 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xl7fl\" (UniqueName: \"kubernetes.io/projected/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-api-access-xl7fl\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:33.843372 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.843351 2552 generic.go:356] "Generic (PLEG): container finished" podID="87bd8a1f-a844-4a10-bd8d-70a9852a7bd5" containerID="cebdd7bcb6f836d806c3bf3b84afdcec6f125317a8df58d21bf0dc1b37184741" exitCode=0 Jul 09 22:28:33.843689 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.843408 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerDied","Data":"cebdd7bcb6f836d806c3bf3b84afdcec6f125317a8df58d21bf0dc1b37184741"} Jul 09 22:28:33.934866 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:33.934830 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:34.327183 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.327084 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:34.327344 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:34.327239 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 22:28:34.327344 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.327250 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:34.327344 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:34.327317 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:35.327295036 +0000 UTC m=+41.226077859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : configmap "kube-rbac-proxy" not found Jul 09 22:28:34.327344 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:34.327319 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 22:28:34.327537 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:34.327387 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:35.327371849 +0000 UTC m=+41.226154654 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : secret "insights-runtime-extractor-tls" not found Jul 09 22:28:34.766722 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.766692 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:34.791043 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.791011 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm"] Jul 09 22:28:34.815899 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.815881 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm"] Jul 09 22:28:34.816016 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.815971 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" Jul 09 22:28:34.819359 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.819343 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4wzq8\"" Jul 09 22:28:34.819647 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.819634 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 22:28:34.820264 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.820252 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 22:28:34.847045 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.847014 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cx995" event={"ID":"400fbc3c-86a2-4987-adf6-ad2fcbf2f96d","Type":"ContainerStarted","Data":"2555632ce80aa0ebbf6914ed69816211d46540032617b609edaba42ea6a57781"} Jul 09 22:28:34.849918 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.849900 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cffd4" event={"ID":"87bd8a1f-a844-4a10-bd8d-70a9852a7bd5","Type":"ContainerStarted","Data":"2b4dd8c7a8311993788b47933ec25e1879f4b373e34d457a1f966678baab17e0"} Jul 09 22:28:34.892640 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.892621 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-82w6l_2693927f-4336-4752-8680-9328d861683a/dns-node-resolver/0.log" Jul 09 22:28:34.914220 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.914198 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:34.932422 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.932404 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt8d4\" (UniqueName: \"kubernetes.io/projected/df1db871-8be2-4882-8438-9fab9e47423b-kube-api-access-bt8d4\") pod \"migrator-d57d58cc9-f7jjm\" (UID: \"df1db871-8be2-4882-8438-9fab9e47423b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" Jul 09 22:28:34.949401 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.948223 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cffd4" podStartSLOduration=17.543455782 podStartE2EDuration="40.948201819s" totalImagesPullingTime="23.404746037s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:54 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:34.946976318 +0000 UTC m=+40.845759127" watchObservedRunningTime="2026-07-09 22:28:34.948201819 +0000 UTC m=+40.846984649" Jul 09 22:28:34.976705 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:34.976672 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cx995" podStartSLOduration=3.391768504 podStartE2EDuration="5.97666058s" totalImagesPullingTime="2.584892076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:34.975771149 +0000 UTC m=+40.874553988" watchObservedRunningTime="2026-07-09 22:28:34.97666058 +0000 UTC m=+40.875443407" Jul 09 22:28:35.033126 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.033052 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt8d4\" (UniqueName: \"kubernetes.io/projected/df1db871-8be2-4882-8438-9fab9e47423b-kube-api-access-bt8d4\") pod \"migrator-d57d58cc9-f7jjm\" (UID: \"df1db871-8be2-4882-8438-9fab9e47423b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" Jul 09 22:28:35.062532 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.062507 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt8d4\" (UniqueName: \"kubernetes.io/projected/df1db871-8be2-4882-8438-9fab9e47423b-kube-api-access-bt8d4\") pod \"migrator-d57d58cc9-f7jjm\" (UID: \"df1db871-8be2-4882-8438-9fab9e47423b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" Jul 09 22:28:35.113862 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.113829 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:35.123838 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.123820 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" Jul 09 22:28:35.217027 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.216997 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:35.279766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.279741 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm"] Jul 09 22:28:35.289181 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:28:35.289107 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf1db871_8be2_4882_8438_9fab9e47423b.slice/crio-d676fafa4c6c38e965da371e9898332f2c91ee9c0e66ccdd6b80739a99576fb7 WatchSource:0}: Error finding container d676fafa4c6c38e965da371e9898332f2c91ee9c0e66ccdd6b80739a99576fb7: Status 404 returned error can't find the container with id d676fafa4c6c38e965da371e9898332f2c91ee9c0e66ccdd6b80739a99576fb7 Jul 09 22:28:35.314215 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.314191 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:35.335321 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.335298 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:35.335387 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.335364 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:35.335460 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:35.335444 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 22:28:35.335460 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:35.335455 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 22:28:35.335525 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:35.335509 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:37.335495087 +0000 UTC m=+43.234277893 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : secret "insights-runtime-extractor-tls" not found Jul 09 22:28:35.335560 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:35.335525 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:37.335517872 +0000 UTC m=+43.234300677 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : configmap "kube-rbac-proxy" not found Jul 09 22:28:35.421950 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.421923 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:35.523782 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.523753 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:35.852820 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.852786 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" event={"ID":"df1db871-8be2-4882-8438-9fab9e47423b","Type":"ContainerStarted","Data":"d676fafa4c6c38e965da371e9898332f2c91ee9c0e66ccdd6b80739a99576fb7"} Jul 09 22:28:35.885192 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:35.885151 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-56fpj_3a2d66cc-9134-4c96-bb3c-df4a05c605fb/node-ca/0.log" Jul 09 22:28:36.684236 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:36.684210 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cx995_400fbc3c-86a2-4987-adf6-ad2fcbf2f96d/serve-healthcheck-canary/0.log" Jul 09 22:28:37.086312 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.086240 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m4pfh"] Jul 09 22:28:37.103548 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.103523 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.107748 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.107726 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m4pfh"] Jul 09 22:28:37.108649 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.108628 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 09 22:28:37.108751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.108685 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 09 22:28:37.109718 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.109691 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 09 22:28:37.109718 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.109689 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lbrsj\"" Jul 09 22:28:37.118413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.118395 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 09 22:28:37.147996 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.147977 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:37.248804 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.248781 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6bea271-5fc5-44d9-b1cf-e9071084466e-signing-key\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.248881 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.248810 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdttb\" (UniqueName: \"kubernetes.io/projected/b6bea271-5fc5-44d9-b1cf-e9071084466e-kube-api-access-jdttb\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.248881 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.248842 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6bea271-5fc5-44d9-b1cf-e9071084466e-signing-cabundle\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.252202 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.252185 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:37.349695 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.349640 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:37.349695 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.349667 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6bea271-5fc5-44d9-b1cf-e9071084466e-signing-key\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.349695 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.349690 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdttb\" (UniqueName: \"kubernetes.io/projected/b6bea271-5fc5-44d9-b1cf-e9071084466e-kube-api-access-jdttb\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.349892 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.349752 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 22:28:37.349892 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.349812 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:37.349892 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.349855 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6bea271-5fc5-44d9-b1cf-e9071084466e-signing-cabundle\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.350031 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.349918 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:41.349900574 +0000 UTC m=+47.248683385 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : configmap "kube-rbac-proxy" not found Jul 09 22:28:37.350031 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.349929 2552 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 22:28:37.350031 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.349946 2552 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh: secret "image-registry-tls" not found Jul 09 22:28:37.350031 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.349971 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:37.350031 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.350003 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls podName:5ab47c69-5b3a-4daa-b3b9-1f42eac485cb nodeName:}" failed. No retries permitted until 2026-07-09 22:28:45.349988035 +0000 UTC m=+51.248770854 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls") pod "image-registry-7dc5cc7f7f-t4qhh" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb") : secret "image-registry-tls" not found Jul 09 22:28:37.350257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.350036 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:37.350257 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.350052 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 22:28:37.350257 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.350101 2552 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 22:28:37.350257 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.350134 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:41.350113581 +0000 UTC m=+47.248896391 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : secret "insights-runtime-extractor-tls" not found Jul 09 22:28:37.350257 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:37.350150 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls podName:e0986295-13f5-4f88-9029-b7a13917159c nodeName:}" failed. No retries permitted until 2026-07-09 22:28:45.350141996 +0000 UTC m=+51.248924804 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls") pod "dns-default-v9r9f" (UID: "e0986295-13f5-4f88-9029-b7a13917159c") : secret "dns-default-metrics-tls" not found Jul 09 22:28:37.350461 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.350446 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b6bea271-5fc5-44d9-b1cf-e9071084466e-signing-cabundle\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.351882 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.351867 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b6bea271-5fc5-44d9-b1cf-e9071084466e-signing-key\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.361456 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.361433 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdttb\" (UniqueName: \"kubernetes.io/projected/b6bea271-5fc5-44d9-b1cf-e9071084466e-kube-api-access-jdttb\") pod \"service-ca-758f599c5-m4pfh\" (UID: \"b6bea271-5fc5-44d9-b1cf-e9071084466e\") " pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.413301 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.413282 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-m4pfh" Jul 09 22:28:37.563823 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.563801 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-m4pfh"] Jul 09 22:28:37.566453 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:28:37.566430 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6bea271_5fc5_44d9_b1cf_e9071084466e.slice/crio-99acbf57befd0cb847407855fe06af03377998319547cdd9c9edde4c942a304b WatchSource:0}: Error finding container 99acbf57befd0cb847407855fe06af03377998319547cdd9c9edde4c942a304b: Status 404 returned error can't find the container with id 99acbf57befd0cb847407855fe06af03377998319547cdd9c9edde4c942a304b Jul 09 22:28:37.858541 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.858473 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" event={"ID":"df1db871-8be2-4882-8438-9fab9e47423b","Type":"ContainerStarted","Data":"980c5da3572c7c8d8ccfa5d77e0c5825c35dd778e389c2bb578176e5eeaf11f1"} Jul 09 22:28:37.858541 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.858537 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" event={"ID":"df1db871-8be2-4882-8438-9fab9e47423b","Type":"ContainerStarted","Data":"9e1676297d0b2dd54a81e2a1d16c87f56d9798657320e04de3307bb79e4d2d17"} Jul 09 22:28:37.859538 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.859515 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-m4pfh" event={"ID":"b6bea271-5fc5-44d9-b1cf-e9071084466e","Type":"ContainerStarted","Data":"99acbf57befd0cb847407855fe06af03377998319547cdd9c9edde4c942a304b"} Jul 09 22:28:37.888020 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:37.887973 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-f7jjm" podStartSLOduration=1.740330069 podStartE2EDuration="3.887960315s" totalImagesPullingTime="2.147630246s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:37.885538982 +0000 UTC m=+43.784321807" watchObservedRunningTime="2026-07-09 22:28:37.887960315 +0000 UTC m=+43.786743142" Jul 09 22:28:38.449630 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:38.449596 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:39.296197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:39.296148 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:39.395857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:39.395825 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:40.868490 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:40.868411 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-m4pfh" event={"ID":"b6bea271-5fc5-44d9-b1cf-e9071084466e","Type":"ContainerStarted","Data":"19c54303b4c0c3bd3baaddd09708c35148a471a9214fa49d63dfb1a406b75939"} Jul 09 22:28:40.893505 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:40.893457 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-m4pfh" podStartSLOduration=0.842202486 podStartE2EDuration="3.893441691s" totalImagesPullingTime="3.051239205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:40.892730142 +0000 UTC m=+46.791512969" watchObservedRunningTime="2026-07-09 22:28:40.893441691 +0000 UTC m=+46.792224520" Jul 09 22:28:41.377861 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:41.377820 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:41.378692 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:41.378196 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 22:28:41.378692 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:41.378357 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:49.378337579 +0000 UTC m=+55.277120385 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : secret "insights-runtime-extractor-tls" not found Jul 09 22:28:41.378878 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:41.378776 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:41.378933 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:41.378879 2552 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 22:28:41.378933 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:41.378927 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:28:49.378912423 +0000 UTC m=+55.277695233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : configmap "kube-rbac-proxy" not found Jul 09 22:28:41.946337 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:41.946225 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:42.124273 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:42.124235 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:42.232266 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:42.232197 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:42.326171 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:42.326120 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:42.814572 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:42.814525 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:42.960887 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:42.960865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:43.198341 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:43.198310 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:43.994531 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:43.994495 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:44.202765 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:44.202733 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:44.401865 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:44.401842 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:44.602341 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:44.602308 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:44.843798 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:44.843717 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:44.956601 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:44.956569 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:45.409882 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.409844 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:45.410385 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.409949 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:45.412245 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.412220 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e0986295-13f5-4f88-9029-b7a13917159c-metrics-tls\") pod \"dns-default-v9r9f\" (UID: \"e0986295-13f5-4f88-9029-b7a13917159c\") " pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:45.412362 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.412342 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"image-registry-7dc5cc7f7f-t4qhh\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:45.428688 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.428666 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:45.440885 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.440868 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:45.570202 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.570153 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-v9r9f"] Jul 09 22:28:45.573807 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:28:45.573779 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0986295_13f5_4f88_9029_b7a13917159c.slice/crio-dca959a123282b38ec7e9dd2b4fce4b511654e64909d08e4091fab7224202df6 WatchSource:0}: Error finding container dca959a123282b38ec7e9dd2b4fce4b511654e64909d08e4091fab7224202df6: Status 404 returned error can't find the container with id dca959a123282b38ec7e9dd2b4fce4b511654e64909d08e4091fab7224202df6 Jul 09 22:28:45.581080 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.581046 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh"] Jul 09 22:28:45.583094 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:28:45.583072 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ab47c69_5b3a_4daa_b3b9_1f42eac485cb.slice/crio-fe8249d9bec30bc71763f42218e1005c2b04d0c59a17b806d8335ce4dcf2b1be WatchSource:0}: Error finding container fe8249d9bec30bc71763f42218e1005c2b04d0c59a17b806d8335ce4dcf2b1be: Status 404 returned error can't find the container with id fe8249d9bec30bc71763f42218e1005c2b04d0c59a17b806d8335ce4dcf2b1be Jul 09 22:28:45.607857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.607838 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:45.708597 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.708545 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:45.808423 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.808389 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:45.882539 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.882512 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" event={"ID":"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb","Type":"ContainerStarted","Data":"995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c"} Jul 09 22:28:45.882698 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.882557 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" event={"ID":"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb","Type":"ContainerStarted","Data":"fe8249d9bec30bc71763f42218e1005c2b04d0c59a17b806d8335ce4dcf2b1be"} Jul 09 22:28:45.882698 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.882608 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:28:45.884045 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.884019 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9r9f" event={"ID":"e0986295-13f5-4f88-9029-b7a13917159c","Type":"ContainerStarted","Data":"dca959a123282b38ec7e9dd2b4fce4b511654e64909d08e4091fab7224202df6"} Jul 09 22:28:45.921626 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:45.921578 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" podStartSLOduration=28.921561415 podStartE2EDuration="28.921561415s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:45.921421975 +0000 UTC m=+51.820204801" watchObservedRunningTime="2026-07-09 22:28:45.921561415 +0000 UTC m=+51.820344220" Jul 09 22:28:46.028609 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:46.028528 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:46.200015 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:46.199969 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:46.419845 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:46.419800 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:46.614294 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:46.614260 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:46.724590 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:46.724510 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:46.792671 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:46.792629 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:47.753698 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:47.753665 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:47.860282 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:47.860254 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:47.957493 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:47.957449 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.055198 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.055174 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.155614 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.155567 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.266940 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.266918 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.411730 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.411702 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.489878 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.489840 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.604836 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.604760 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.681047 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.681013 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:48.894137 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.894108 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9r9f" event={"ID":"e0986295-13f5-4f88-9029-b7a13917159c","Type":"ContainerStarted","Data":"c694b1989ae2adb3258d6a2c9864cf7f53aa625f95551c68bda0a6a01922de6f"} Jul 09 22:28:48.894516 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.894174 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-v9r9f" event={"ID":"e0986295-13f5-4f88-9029-b7a13917159c","Type":"ContainerStarted","Data":"f243d2ac0638a52bf75650430a2249376ad4fc9c611ee234944efe69b107ec88"} Jul 09 22:28:48.894516 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:48.894232 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:49.056014 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.055988 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:49.127174 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.127128 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:49.399815 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.399785 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:49.443934 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.443910 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:49.444028 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.443964 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:49.444071 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:49.444051 2552 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 22:28:49.444128 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:28:49.444118 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls podName:34d1101b-5c0e-4e20-bc76-a5f839b8e9c1 nodeName:}" failed. No retries permitted until 2026-07-09 22:29:05.444102766 +0000 UTC m=+71.342885574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls") pod "insights-runtime-extractor-t7qdq" (UID: "34d1101b-5c0e-4e20-bc76-a5f839b8e9c1") : secret "insights-runtime-extractor-tls" not found Jul 09 22:28:49.444416 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.444399 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:28:49.503195 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.503169 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:49.828665 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:49.828590 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:50.012442 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:50.012407 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:50.109958 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:50.109891 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:50.197407 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:50.197380 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:50.639895 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:50.639865 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:50.839868 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:50.839843 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:51.218064 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:51.218034 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:51.833518 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:51.833492 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:52.252705 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:52.252675 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:52.654926 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:52.654892 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:52.850033 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:52.850004 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:53.022892 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:53.022813 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:54.303919 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:54.303890 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:54.479152 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:54.479115 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:28:55.439381 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:55.439355 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wpx72" Jul 09 22:28:55.495145 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:55.495092 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-v9r9f" podStartSLOduration=24.037000529 podStartE2EDuration="26.495077991s" totalImagesPullingTime="2.458077462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:28:48.918657548 +0000 UTC m=+54.817440375" watchObservedRunningTime="2026-07-09 22:28:55.495077991 +0000 UTC m=+61.393860800" Jul 09 22:28:58.900350 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:58.900322 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-v9r9f" Jul 09 22:28:59.908545 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.908510 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8"] Jul 09 22:28:59.912147 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.912126 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:28:59.915266 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.915247 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Jul 09 22:28:59.916742 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.916726 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Jul 09 22:28:59.917671 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.917651 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 09 22:28:59.917864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.917849 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Jul 09 22:28:59.917933 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.917849 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 09 22:28:59.921869 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.921855 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Jul 09 22:28:59.921958 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.921866 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 09 22:28:59.975128 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:28:59.975106 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8"] Jul 09 22:29:00.016645 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.016620 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.016746 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.016668 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjkg\" (UniqueName: \"kubernetes.io/projected/f1ccd10d-ef29-48a9-b49d-4b31472ef826-kube-api-access-7bjkg\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.016746 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.016722 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1ccd10d-ef29-48a9-b49d-4b31472ef826-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.016860 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.016762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-hub\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.016860 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.016826 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.016936 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.016869 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-ca\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.044432 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.044408 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh"] Jul 09 22:29:00.045231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.045207 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-prtnq"] Jul 09 22:29:00.047651 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.047633 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:00.049008 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.048983 2552 patch_prober.go:28] interesting pod/image-registry-7dc5cc7f7f-t4qhh container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 22:29:00.049083 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.049039 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" podUID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 22:29:00.053603 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.053585 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bpvvm\"" Jul 09 22:29:00.053603 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.053594 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 22:29:00.074813 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.074796 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 22:29:00.103284 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.103261 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-prtnq"] Jul 09 22:29:00.117234 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89fsv\" (UniqueName: \"kubernetes.io/projected/d9852ef0-8138-4818-93fd-9da911a0787e-kube-api-access-89fsv\") pod \"downloads-685bfb5f64-prtnq\" (UID: \"d9852ef0-8138-4818-93fd-9da911a0787e\") " pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:00.117322 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117246 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.117322 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117273 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjkg\" (UniqueName: \"kubernetes.io/projected/f1ccd10d-ef29-48a9-b49d-4b31472ef826-kube-api-access-7bjkg\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.117399 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117336 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1ccd10d-ef29-48a9-b49d-4b31472ef826-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.117399 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117374 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-hub\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.117525 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117506 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.117570 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117543 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-ca\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.118011 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.117987 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1ccd10d-ef29-48a9-b49d-4b31472ef826-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.119675 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.119652 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-hub\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.119759 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.119720 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-ca\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.119812 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.119798 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.119877 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.119861 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1ccd10d-ef29-48a9-b49d-4b31472ef826-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.161538 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.161484 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjkg\" (UniqueName: \"kubernetes.io/projected/f1ccd10d-ef29-48a9-b49d-4b31472ef826-kube-api-access-7bjkg\") pod \"cluster-proxy-proxy-agent-6cf99d5649-crkx8\" (UID: \"f1ccd10d-ef29-48a9-b49d-4b31472ef826\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.218042 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.218015 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89fsv\" (UniqueName: \"kubernetes.io/projected/d9852ef0-8138-4818-93fd-9da911a0787e-kube-api-access-89fsv\") pod \"downloads-685bfb5f64-prtnq\" (UID: \"d9852ef0-8138-4818-93fd-9da911a0787e\") " pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:00.227962 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.227941 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" Jul 09 22:29:00.272717 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.271708 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89fsv\" (UniqueName: \"kubernetes.io/projected/d9852ef0-8138-4818-93fd-9da911a0787e-kube-api-access-89fsv\") pod \"downloads-685bfb5f64-prtnq\" (UID: \"d9852ef0-8138-4818-93fd-9da911a0787e\") " pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:00.272717 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.272213 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:00.301771 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.301743 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-67975944b9-lmftf"] Jul 09 22:29:00.305658 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.305636 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.319113 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.319089 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:29:00.319252 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.319201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:29:00.338537 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.338520 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 22:29:00.341404 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.341386 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2327c414-5cc3-446b-8261-3c87acd3ea07-original-pull-secret\") pod \"global-pull-secret-syncer-fnlb7\" (UID: \"2327c414-5cc3-446b-8261-3c87acd3ea07\") " pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:29:00.343202 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.343186 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 22:29:00.352116 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.352097 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7540a706-475e-457e-a0c7-3fcc142e8ea6-metrics-certs\") pod \"network-metrics-daemon-5d8hc\" (UID: \"7540a706-475e-457e-a0c7-3fcc142e8ea6\") " pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:29:00.355501 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.355485 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:00.359525 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.359502 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67975944b9-lmftf"] Jul 09 22:29:00.419687 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419628 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-trusted-ca\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.419687 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419662 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-image-registry-private-configuration\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.419830 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419699 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-ca-trust-extracted\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.419830 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419784 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-registry-certificates\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.419830 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419821 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-bound-sa-token\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.419961 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419899 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:29:00.419961 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419933 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-installation-pull-secrets\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.420054 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419958 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg4hk\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-kube-api-access-gg4hk\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.420054 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.419992 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-registry-tls\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.440864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.440844 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 22:29:00.449767 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.449744 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8"] Jul 09 22:29:00.455775 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:00.455747 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ccd10d_ef29_48a9_b49d_4b31472ef826.slice/crio-35c33b4990ba9d3397c3e953e2fb821d84fe7f14a8655f08636582a76c31340d WatchSource:0}: Error finding container 35c33b4990ba9d3397c3e953e2fb821d84fe7f14a8655f08636582a76c31340d: Status 404 returned error can't find the container with id 35c33b4990ba9d3397c3e953e2fb821d84fe7f14a8655f08636582a76c31340d Jul 09 22:29:00.457775 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.457642 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 22:29:00.463251 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.463222 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgskd\" (UniqueName: \"kubernetes.io/projected/1e5289ee-610e-431f-b3f7-56cf0a9a6e9c-kube-api-access-dgskd\") pod \"network-check-target-tntl4\" (UID: \"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c\") " pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:29:00.508057 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.508038 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-prtnq"] Jul 09 22:29:00.510031 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:00.510007 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9852ef0_8138_4818_93fd_9da911a0787e.slice/crio-98238ee3f7ebab8bd9e269d43107026ff73f57980982502aec21a2e85caa99c5 WatchSource:0}: Error finding container 98238ee3f7ebab8bd9e269d43107026ff73f57980982502aec21a2e85caa99c5: Status 404 returned error can't find the container with id 98238ee3f7ebab8bd9e269d43107026ff73f57980982502aec21a2e85caa99c5 Jul 09 22:29:00.514287 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.514267 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:00.520295 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520276 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-bound-sa-token\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520372 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520320 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-installation-pull-secrets\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520372 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520336 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg4hk\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-kube-api-access-gg4hk\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520436 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520385 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-registry-tls\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520436 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-trusted-ca\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520456 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-image-registry-private-configuration\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520614 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520496 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-ca-trust-extracted\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520614 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520532 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-registry-certificates\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.520985 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.520962 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-ca-trust-extracted\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.521437 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.521414 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-registry-certificates\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.521527 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.521432 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-trusted-ca\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.522518 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.522496 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-installation-pull-secrets\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.522658 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.522640 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-registry-tls\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.522796 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.522776 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-image-registry-private-configuration\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.538660 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.538633 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-bound-sa-token\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.542743 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.542725 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg4hk\" (UniqueName: \"kubernetes.io/projected/bcfc98ac-0003-4e58-a1cc-e49aa7daa541-kube-api-access-gg4hk\") pod \"image-registry-67975944b9-lmftf\" (UID: \"bcfc98ac-0003-4e58-a1cc-e49aa7daa541\") " pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.557988 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.557965 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-2swrh\"" Jul 09 22:29:00.560054 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.560037 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fnlb7" Jul 09 22:29:00.563427 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.563411 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:29:00.568630 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.568614 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b9x2j\"" Jul 09 22:29:00.576500 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.576468 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5d8hc" Jul 09 22:29:00.616050 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.615363 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.710279 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.710252 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tntl4"] Jul 09 22:29:00.713456 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:00.713429 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e5289ee_610e_431f_b3f7_56cf0a9a6e9c.slice/crio-cde2fbe60a2dd543556edbd684a70b63ea2cce7fd36d75dc850a0a52edab2e38 WatchSource:0}: Error finding container cde2fbe60a2dd543556edbd684a70b63ea2cce7fd36d75dc850a0a52edab2e38: Status 404 returned error can't find the container with id cde2fbe60a2dd543556edbd684a70b63ea2cce7fd36d75dc850a0a52edab2e38 Jul 09 22:29:00.721029 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.720989 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:00.747425 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.747401 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fnlb7"] Jul 09 22:29:00.750250 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:00.750226 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2327c414_5cc3_446b_8261_3c87acd3ea07.slice/crio-6ab76eb11d4f1ec27285a0755e4de962f7f5574b17d31743314935bd32dfcbb2 WatchSource:0}: Error finding container 6ab76eb11d4f1ec27285a0755e4de962f7f5574b17d31743314935bd32dfcbb2: Status 404 returned error can't find the container with id 6ab76eb11d4f1ec27285a0755e4de962f7f5574b17d31743314935bd32dfcbb2 Jul 09 22:29:00.757096 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.757075 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5d8hc"] Jul 09 22:29:00.759773 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:00.759754 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7540a706_475e_457e_a0c7_3fcc142e8ea6.slice/crio-84df1004b07ab8abd7b760b40fa4edbb9d7d23fd002332b9bac004b81f4c4615 WatchSource:0}: Error finding container 84df1004b07ab8abd7b760b40fa4edbb9d7d23fd002332b9bac004b81f4c4615: Status 404 returned error can't find the container with id 84df1004b07ab8abd7b760b40fa4edbb9d7d23fd002332b9bac004b81f4c4615 Jul 09 22:29:00.799902 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.799883 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-67975944b9-lmftf"] Jul 09 22:29:00.802975 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:00.802945 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcfc98ac_0003_4e58_a1cc_e49aa7daa541.slice/crio-def752979a07edb0956b0fa3dd0fbbc2d7736ad0d3135ffe054148e3d9faae8a WatchSource:0}: Error finding container def752979a07edb0956b0fa3dd0fbbc2d7736ad0d3135ffe054148e3d9faae8a: Status 404 returned error can't find the container with id def752979a07edb0956b0fa3dd0fbbc2d7736ad0d3135ffe054148e3d9faae8a Jul 09 22:29:00.856791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.856772 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:00.930518 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.930457 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-prtnq" event={"ID":"d9852ef0-8138-4818-93fd-9da911a0787e","Type":"ContainerStarted","Data":"98238ee3f7ebab8bd9e269d43107026ff73f57980982502aec21a2e85caa99c5"} Jul 09 22:29:00.931735 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.931704 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tntl4" event={"ID":"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c","Type":"ContainerStarted","Data":"cde2fbe60a2dd543556edbd684a70b63ea2cce7fd36d75dc850a0a52edab2e38"} Jul 09 22:29:00.932941 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.932912 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fnlb7" event={"ID":"2327c414-5cc3-446b-8261-3c87acd3ea07","Type":"ContainerStarted","Data":"6ab76eb11d4f1ec27285a0755e4de962f7f5574b17d31743314935bd32dfcbb2"} Jul 09 22:29:00.934323 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.934295 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67975944b9-lmftf" event={"ID":"bcfc98ac-0003-4e58-a1cc-e49aa7daa541","Type":"ContainerStarted","Data":"dd19074388b907ab588e599773c0a625b44a60f293dc98f99408c40525051a70"} Jul 09 22:29:00.934409 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.934337 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-67975944b9-lmftf" event={"ID":"bcfc98ac-0003-4e58-a1cc-e49aa7daa541","Type":"ContainerStarted","Data":"def752979a07edb0956b0fa3dd0fbbc2d7736ad0d3135ffe054148e3d9faae8a"} Jul 09 22:29:00.934454 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.934410 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:00.935360 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.935335 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" event={"ID":"f1ccd10d-ef29-48a9-b49d-4b31472ef826","Type":"ContainerStarted","Data":"35c33b4990ba9d3397c3e953e2fb821d84fe7f14a8655f08636582a76c31340d"} Jul 09 22:29:00.936346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.936329 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5d8hc" event={"ID":"7540a706-475e-457e-a0c7-3fcc142e8ea6","Type":"ContainerStarted","Data":"84df1004b07ab8abd7b760b40fa4edbb9d7d23fd002332b9bac004b81f4c4615"} Jul 09 22:29:00.986525 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:00.986476 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-67975944b9-lmftf" podStartSLOduration=0.986463602 podStartE2EDuration="986.463602ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:00.985637289 +0000 UTC m=+66.884420116" watchObservedRunningTime="2026-07-09 22:29:00.986463602 +0000 UTC m=+66.885246408" Jul 09 22:29:01.014877 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:01.014847 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:01.520059 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:01.520026 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:01.742813 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:01.742781 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:01.995940 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:01.995877 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:02.163065 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:02.162985 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:02.424027 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:02.423914 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:02.589015 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:02.588981 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:04.960911 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:04.960818 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5d8hc" event={"ID":"7540a706-475e-457e-a0c7-3fcc142e8ea6","Type":"ContainerStarted","Data":"1c1ca1e182e226dfc100888dadbd17be8abb42f54f4c6012c1ea44a2eac7d686"} Jul 09 22:29:04.960911 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:04.960878 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5d8hc" event={"ID":"7540a706-475e-457e-a0c7-3fcc142e8ea6","Type":"ContainerStarted","Data":"45a19f9d2723d2166c58475ede954547fe264434fe134fcc7d9ffe8e69c87895"} Jul 09 22:29:05.149931 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.149895 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:05.297621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.297518 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:05.452338 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.452302 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:05.465309 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.465281 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:29:05.468051 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.468022 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/34d1101b-5c0e-4e20-bc76-a5f839b8e9c1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-t7qdq\" (UID: \"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1\") " pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:29:05.701962 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.701928 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-f5vmj\"" Jul 09 22:29:05.709415 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:05.709388 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-t7qdq" Jul 09 22:29:06.339957 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:06.339922 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:06.678120 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:06.678082 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:07.747296 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:07.747223 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:07.891092 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:07.891014 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:08.489257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.489199 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5d8hc" podStartSLOduration=70.385124068 podStartE2EDuration="1m13.489177278s" totalImagesPullingTime="3.10405321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:04.996241081 +0000 UTC m=+70.895023908" watchObservedRunningTime="2026-07-09 22:29:08.489177278 +0000 UTC m=+74.387960107" Jul 09 22:29:08.490761 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.490663 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-t7qdq"] Jul 09 22:29:08.851479 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.851404 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:08.978032 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.977987 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tntl4" event={"ID":"1e5289ee-610e-431f-b3f7-56cf0a9a6e9c","Type":"ContainerStarted","Data":"a65eff78b4f9afba4135be073c917f83f43ff5ab481ef3f3c5b448a11e053e0b"} Jul 09 22:29:08.978313 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.978216 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:29:08.980731 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.980680 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fnlb7" event={"ID":"2327c414-5cc3-446b-8261-3c87acd3ea07","Type":"ContainerStarted","Data":"6601d737d8bc67b0d7adb876ff3a7ee79e295e337c4dd9a86af0c080b881441d"} Jul 09 22:29:08.984315 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.984287 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" event={"ID":"f1ccd10d-ef29-48a9-b49d-4b31472ef826","Type":"ContainerStarted","Data":"1a43059ad94548ffe8585a017cd3117f11029c49e0ac1eaf6021b73e8b2fc94d"} Jul 09 22:29:08.984427 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.984329 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" event={"ID":"f1ccd10d-ef29-48a9-b49d-4b31472ef826","Type":"ContainerStarted","Data":"e59748014f6a43b402021b903f772706f815a81ac5116a7a55c84f4cac4024d0"} Jul 09 22:29:08.984427 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.984347 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" event={"ID":"f1ccd10d-ef29-48a9-b49d-4b31472ef826","Type":"ContainerStarted","Data":"c4a36cb3f3b86aa310005fe0da13e2343c3c2bc93b2b35c5a4db1829d1204f7d"} Jul 09 22:29:08.987562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:08.987537 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qdq" event={"ID":"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1","Type":"ContainerStarted","Data":"4e6a3e8f7fcfcd96b4babb3ef5fd4ec841fd6f830478ac771dd66b4b6208746c"} Jul 09 22:29:09.024950 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.024896 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tntl4" podStartSLOduration=66.462555701 podStartE2EDuration="1m14.024879261s" totalImagesPullingTime="7.56232356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:09.024308591 +0000 UTC m=+74.923091437" watchObservedRunningTime="2026-07-09 22:29:09.024879261 +0000 UTC m=+74.923662089" Jul 09 22:29:09.067050 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.066997 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fnlb7" podStartSLOduration=66.525356593 podStartE2EDuration="1m14.066985253s" totalImagesPullingTime="7.54162866s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:09.065626959 +0000 UTC m=+74.964409789" watchObservedRunningTime="2026-07-09 22:29:09.066985253 +0000 UTC m=+74.965768081" Jul 09 22:29:09.092125 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.092056 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:09.107334 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.107228 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6cf99d5649-crkx8" podStartSLOduration=2.270069243 podStartE2EDuration="10.10720921s" totalImagesPullingTime="7.837139967s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:09.105625041 +0000 UTC m=+75.004407870" watchObservedRunningTime="2026-07-09 22:29:09.10720921 +0000 UTC m=+75.005992037" Jul 09 22:29:09.236327 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.236293 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:09.467894 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.467850 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:09.678367 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:09.678324 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:10.051923 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:10.051862 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:29:10.567572 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:10.567531 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:11.081576 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:11.081529 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:12.991536 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:12.991506 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:13.004589 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:13.004565 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qdq" event={"ID":"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1","Type":"ContainerStarted","Data":"039ca529e12900f70416d1b2a0ec1ea3dea933744eac5263b2695d5e737760b7"} Jul 09 22:29:13.169741 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:13.169711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:14.274644 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:14.274603 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:14.799529 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:14.799492 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:14.906742 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:14.906711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:15.798363 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:15.798332 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:15.949865 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:15.949827 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.080221 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:16.080135 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.460916 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:16.460877 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.579108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:16.579066 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.844291 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:16.844129 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:16.974977 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:16.974940 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.188421 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.188382 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.374596 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.374557 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8zjrm"] Jul 09 22:29:17.380993 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.380969 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.388663 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.388193 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 22:29:17.389252 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.388878 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 22:29:17.389252 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.388944 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 22:29:17.389252 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.389140 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 22:29:17.389577 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.389554 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 22:29:17.389577 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.389569 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-4smjs\"" Jul 09 22:29:17.389733 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.389583 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 22:29:17.415911 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.415868 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.469675 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469576 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-root\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.469675 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469629 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.469888 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469736 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-metrics-client-ca\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.469888 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469760 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.469888 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469819 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-wtmp\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.469888 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-tls\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.469888 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469877 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlm8w\" (UniqueName: \"kubernetes.io/projected/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-kube-api-access-qlm8w\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.470106 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469964 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-textfile\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.470106 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.469999 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-sys\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.545498 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.545437 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.571284 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571257 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlm8w\" (UniqueName: \"kubernetes.io/projected/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-kube-api-access-qlm8w\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571431 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571306 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-textfile\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571493 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571476 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-sys\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571553 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571524 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-root\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571586 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-sys\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571591 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571617 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-root\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571769 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571629 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-textfile\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571769 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571658 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-metrics-client-ca\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571769 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571696 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571769 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571736 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-wtmp\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571942 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571774 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-tls\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.571942 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.571906 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-wtmp\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.572275 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.572251 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-metrics-client-ca\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.572395 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.572275 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-accelerators-collector-config\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.574133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.574098 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-tls\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.574269 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.574243 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.589713 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.589692 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlm8w\" (UniqueName: \"kubernetes.io/projected/e363b123-5cb9-4d50-af5c-8a37b7dd5fbc-kube-api-access-qlm8w\") pod \"node-exporter-8zjrm\" (UID: \"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc\") " pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.691982 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.691951 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8zjrm" Jul 09 22:29:17.699884 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.699858 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:17.940841 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:17.940813 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:18.334543 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:18.334414 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:18.565575 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:18.565544 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:18.691815 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:18.691783 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:18.914365 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:18.914335 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:19.824964 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:29:19.824937 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode363b123_5cb9_4d50_af5c_8a37b7dd5fbc.slice/crio-484a744ec18f7d980663f8d95db1ebc5160a1085e90de896a635907dece95874 WatchSource:0}: Error finding container 484a744ec18f7d980663f8d95db1ebc5160a1085e90de896a635907dece95874: Status 404 returned error can't find the container with id 484a744ec18f7d980663f8d95db1ebc5160a1085e90de896a635907dece95874 Jul 09 22:29:20.032398 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:20.032364 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zjrm" event={"ID":"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc","Type":"ContainerStarted","Data":"484a744ec18f7d980663f8d95db1ebc5160a1085e90de896a635907dece95874"} Jul 09 22:29:20.167416 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:20.167379 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.422980 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:20.422888 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.523443 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:20.523402 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.626284 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:20.626246 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:20.728244 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:20.728123 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:21.039593 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.039503 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qdq" event={"ID":"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1","Type":"ContainerStarted","Data":"2f3445f5a788a8ada6499bf735c82d73dbcd128abf03e6ae29627b310ff7a6e3"} Jul 09 22:29:21.042211 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.041979 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-prtnq" event={"ID":"d9852ef0-8138-4818-93fd-9da911a0787e","Type":"ContainerStarted","Data":"3bb43dddb71cc209fc5a8347d32f9401a1c478ff245118eaed9b8ae3ea181403"} Jul 09 22:29:21.043985 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.042735 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:21.055637 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.055614 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-prtnq" Jul 09 22:29:21.055968 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.055945 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:21.065549 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.065495 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-prtnq" podStartSLOduration=2.381133243 podStartE2EDuration="22.065479776s" totalImagesPullingTime="19.684346533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:28:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:21.064885623 +0000 UTC m=+86.963668451" watchObservedRunningTime="2026-07-09 22:29:21.065479776 +0000 UTC m=+86.964262603" Jul 09 22:29:21.160668 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.160610 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:21.847365 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.847297 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:21.953401 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.952506 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-67975944b9-lmftf" Jul 09 22:29:21.978049 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:21.978009 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:22.048857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.048618 2552 generic.go:356] "Generic (PLEG): container finished" podID="e363b123-5cb9-4d50-af5c-8a37b7dd5fbc" containerID="be4720511f4b5911a4e89c139c4c616e0a7404e57acef78631af03a93318ed2d" exitCode=0 Jul 09 22:29:22.048857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.048771 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zjrm" event={"ID":"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc","Type":"ContainerDied","Data":"be4720511f4b5911a4e89c139c4c616e0a7404e57acef78631af03a93318ed2d"} Jul 09 22:29:22.124214 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.124184 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:22.240901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.240827 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:22.379874 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.379841 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:22.757568 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.757452 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:22.829597 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:22.829562 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:23.057022 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:23.056937 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zjrm" event={"ID":"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc","Type":"ContainerStarted","Data":"53ba26c2dc62d0b2733fd71470c2311558e991f831bd5f3656a22eff517901b1"} Jul 09 22:29:23.057022 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:23.056998 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8zjrm" event={"ID":"e363b123-5cb9-4d50-af5c-8a37b7dd5fbc","Type":"ContainerStarted","Data":"db3a65d4c2a614379abc0c8ca667944ae17e00cff3595f8b27f5d3549bea7458"} Jul 09 22:29:23.083436 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:23.083372 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8zjrm" podStartSLOduration=4.688966054 podStartE2EDuration="6.083353761s" totalImagesPullingTime="1.293221195s" totalInitContainerRuntime="101.166512ms" isStatefulPod=true podCreationTimestamp="2026-07-09 22:29:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:23.082457519 +0000 UTC m=+88.981240350" watchObservedRunningTime="2026-07-09 22:29:23.083353761 +0000 UTC m=+88.982136589" Jul 09 22:29:23.590645 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:23.590591 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:24.269694 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:24.269661 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:24.341024 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:24.340997 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:25.063892 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.063848 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" podUID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" containerName="registry" containerID="cri-o://995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c" gracePeriod=30 Jul 09 22:29:25.067691 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.067631 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-t7qdq" event={"ID":"34d1101b-5c0e-4e20-bc76-a5f839b8e9c1","Type":"ContainerStarted","Data":"16db54c46e2439a303a595a01f13f185410753cc3eee7c647324d9df61524de3"} Jul 09 22:29:25.091393 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.091352 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-t7qdq" podStartSLOduration=36.629728527 podStartE2EDuration="52.091337628s" totalImagesPullingTime="15.461609101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:28:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:29:25.090351092 +0000 UTC m=+90.989133918" watchObservedRunningTime="2026-07-09 22:29:25.091337628 +0000 UTC m=+90.990120456" Jul 09 22:29:25.378833 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.378809 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:29:25.541357 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541319 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-installation-pull-secrets\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541539 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541381 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwphv\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-kube-api-access-kwphv\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541539 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541415 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-certificates\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541672 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541576 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-bound-sa-token\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541672 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541627 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-image-registry-private-configuration\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541672 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541656 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541837 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541684 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-trusted-ca\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541837 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541700 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:25.541837 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541719 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-ca-trust-extracted\") pod \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\" (UID: \"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb\") " Jul 09 22:29:25.541979 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.541949 2552 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-certificates\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.542078 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.542027 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:29:25.544435 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.544335 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:29:25.544634 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.544608 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:29:25.544736 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.544686 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-kube-api-access-kwphv" (OuterVolumeSpecName: "kube-api-access-kwphv") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "kube-api-access-kwphv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:29:25.544736 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.544695 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:29:25.544870 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.544839 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:29:25.552716 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.552688 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" (UID: "5ab47c69-5b3a-4daa-b3b9-1f42eac485cb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:29:25.642850 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642826 2552 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-bound-sa-token\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.642973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642854 2552 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-image-registry-private-configuration\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.642973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642868 2552 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-registry-tls\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.642973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642879 2552 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-trusted-ca\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.642973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642889 2552 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-ca-trust-extracted\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.642973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642906 2552 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-installation-pull-secrets\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:25.642973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:25.642918 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwphv\" (UniqueName: \"kubernetes.io/projected/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb-kube-api-access-kwphv\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:29:26.073278 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.073190 2552 generic.go:356] "Generic (PLEG): container finished" podID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" containerID="995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c" exitCode=0 Jul 09 22:29:26.073278 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.073236 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" Jul 09 22:29:26.073481 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.073271 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" event={"ID":"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb","Type":"ContainerDied","Data":"995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c"} Jul 09 22:29:26.073481 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.073351 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh" event={"ID":"5ab47c69-5b3a-4daa-b3b9-1f42eac485cb","Type":"ContainerDied","Data":"fe8249d9bec30bc71763f42218e1005c2b04d0c59a17b806d8335ce4dcf2b1be"} Jul 09 22:29:26.073481 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.073377 2552 scope.go:117] "RemoveContainer" containerID="995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c" Jul 09 22:29:26.083257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.083237 2552 scope.go:117] "RemoveContainer" containerID="995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c" Jul 09 22:29:26.083567 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:29:26.083544 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c\": container with ID starting with 995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c not found: ID does not exist" containerID="995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c" Jul 09 22:29:26.083660 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.083576 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c"} err="failed to get container status \"995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c\": rpc error: code = NotFound desc = could not find container \"995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c\": container with ID starting with 995a8aac4a3af9a4faa398b4ee942f07bacdf9a6f42fa6df0a15422813f02e3c not found: ID does not exist" Jul 09 22:29:26.101753 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.101728 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh"] Jul 09 22:29:26.105683 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.105658 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dc5cc7f7f-t4qhh"] Jul 09 22:29:26.548330 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:26.548299 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" path="/var/lib/kubelet/pods/5ab47c69-5b3a-4daa-b3b9-1f42eac485cb/volumes" Jul 09 22:29:27.169579 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:27.169537 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:27.239133 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:27.239100 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:30.073089 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:30.073062 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:30.141493 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:30.141457 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:33.984852 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:33.984786 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:34.085853 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:34.085810 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:34.185003 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:34.184970 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:36.708134 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:36.708104 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:39.262933 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:39.262899 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:39.339883 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:39.339852 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:39.994806 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:39.994773 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tntl4" Jul 09 22:29:49.315773 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:49.315739 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:29:49.391451 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:29:49.391417 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:02.365413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:02.365375 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:02.487652 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:02.487616 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:02.580759 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:02.580729 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:36.497723 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:36.497693 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:36.619547 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:36.619514 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:38.815101 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:38.815072 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:45.966703 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:45.966668 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:46.038729 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:46.038700 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:51.153626 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:51.153548 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:57.332789 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:57.332750 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:57.437189 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:57.437140 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:30:57.538795 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:30:57.538764 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:31:09.495791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:31:09.495760 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:10.322259 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:10.322223 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:10.401983 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:10.401931 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:22.271458 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:22.271376 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:22.342250 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:22.342216 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:39.269781 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:39.269744 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:39.369038 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:39.369003 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:39.659621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:39.659591 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:48.214564 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:48.214523 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:49.664139 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:49.664103 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:54.427523 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:54.427496 2552 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 22:32:58.856295 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:58.856262 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:58.960595 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:58.960562 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:32:59.056434 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:32:59.056401 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:05.984336 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:05.984293 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:06.083033 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:06.083002 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:33.288360 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:33.288325 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:33.660624 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:33.660581 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:37.101134 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:37.101097 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:37.198953 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:37.198927 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:40.508797 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:40.508756 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:40.736344 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:40.736311 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:41.078677 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.078645 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x25x7"] Jul 09 22:33:41.078923 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.078911 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" containerName="registry" Jul 09 22:33:41.078966 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.078924 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" containerName="registry" Jul 09 22:33:41.079001 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.078967 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ab47c69-5b3a-4daa-b3b9-1f42eac485cb" containerName="registry" Jul 09 22:33:41.081746 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.081729 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.084404 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.084381 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-h9zdb\"" Jul 09 22:33:41.084551 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.084431 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 22:33:41.090346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.090321 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 22:33:41.139624 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.139582 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kttc8\" (UniqueName: \"kubernetes.io/projected/942332d9-6ec4-4e34-987f-a3891a4b0d7e-kube-api-access-kttc8\") pod \"cert-manager-webhook-6486ffd997-x25x7\" (UID: \"942332d9-6ec4-4e34-987f-a3891a4b0d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.139802 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.139631 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/942332d9-6ec4-4e34-987f-a3891a4b0d7e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x25x7\" (UID: \"942332d9-6ec4-4e34-987f-a3891a4b0d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.150446 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.150419 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x25x7"] Jul 09 22:33:41.240260 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.240225 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/942332d9-6ec4-4e34-987f-a3891a4b0d7e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x25x7\" (UID: \"942332d9-6ec4-4e34-987f-a3891a4b0d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.240417 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.240309 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kttc8\" (UniqueName: \"kubernetes.io/projected/942332d9-6ec4-4e34-987f-a3891a4b0d7e-kube-api-access-kttc8\") pod \"cert-manager-webhook-6486ffd997-x25x7\" (UID: \"942332d9-6ec4-4e34-987f-a3891a4b0d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.267689 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.267662 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/942332d9-6ec4-4e34-987f-a3891a4b0d7e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-x25x7\" (UID: \"942332d9-6ec4-4e34-987f-a3891a4b0d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.268696 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.268671 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kttc8\" (UniqueName: \"kubernetes.io/projected/942332d9-6ec4-4e34-987f-a3891a4b0d7e-kube-api-access-kttc8\") pod \"cert-manager-webhook-6486ffd997-x25x7\" (UID: \"942332d9-6ec4-4e34-987f-a3891a4b0d7e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.390848 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.390815 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:41.523983 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.523952 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-x25x7"] Jul 09 22:33:41.527234 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:33:41.527201 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod942332d9_6ec4_4e34_987f_a3891a4b0d7e.slice/crio-0e73ede261994e5143a23d2faedfd9cbcb4860909b4cf6e3c4dbfe5a9ea31c40 WatchSource:0}: Error finding container 0e73ede261994e5143a23d2faedfd9cbcb4860909b4cf6e3c4dbfe5a9ea31c40: Status 404 returned error can't find the container with id 0e73ede261994e5143a23d2faedfd9cbcb4860909b4cf6e3c4dbfe5a9ea31c40 Jul 09 22:33:41.531192 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.529469 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:33:41.877004 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:41.876974 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" event={"ID":"942332d9-6ec4-4e34-987f-a3891a4b0d7e","Type":"ContainerStarted","Data":"0e73ede261994e5143a23d2faedfd9cbcb4860909b4cf6e3c4dbfe5a9ea31c40"} Jul 09 22:33:42.791257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:42.791219 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:43.382460 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:43.382428 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:44.890414 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:44.890325 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" event={"ID":"942332d9-6ec4-4e34-987f-a3891a4b0d7e","Type":"ContainerStarted","Data":"f47f21415cd32063c4adc8c0ccbac45427ffdfb03b8e5615ba213f4077fb3524"} Jul 09 22:33:44.890792 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:44.890461 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:44.914709 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:44.914664 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" podStartSLOduration=0.809032412 podStartE2EDuration="3.914651984s" totalImagesPullingTime="3.105619572s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:33:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:33:44.912417035 +0000 UTC m=+350.811199864" watchObservedRunningTime="2026-07-09 22:33:44.914651984 +0000 UTC m=+350.813434812" Jul 09 22:33:50.897316 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:50.897242 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-x25x7" Jul 09 22:33:51.353732 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:51.353644 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:51.461222 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:51.461149 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:58.743453 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:58.743423 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:33:58.841567 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:33:58.841538 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:00.791613 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:00.791575 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:10.675901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:10.675860 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:10.784984 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:10.784952 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:12.517181 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:12.517125 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:12.648839 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:12.648799 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:13.130772 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.130737 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:13.647093 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.647061 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:13.763643 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.763618 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:13.841677 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.841652 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f"] Jul 09 22:34:13.848090 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.848075 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:13.850825 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.850805 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 22:34:13.850932 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.850845 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 22:34:13.851143 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.851125 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dsh7n\"" Jul 09 22:34:13.851892 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.851869 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 22:34:13.852202 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.851899 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 22:34:13.869779 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.869754 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f"] Jul 09 22:34:13.953944 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.953858 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4935f051-3669-406c-a548-9889b76b1b50-tmp\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:13.953944 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.953907 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4935f051-3669-406c-a548-9889b76b1b50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:13.954134 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.953952 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4935f051-3669-406c-a548-9889b76b1b50-manifests\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:13.954134 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.954013 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4935f051-3669-406c-a548-9889b76b1b50-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:13.954134 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:13.954032 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fc6ls\" (UniqueName: \"kubernetes.io/projected/4935f051-3669-406c-a548-9889b76b1b50-kube-api-access-fc6ls\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.054650 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.054613 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4935f051-3669-406c-a548-9889b76b1b50-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.054650 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.054652 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fc6ls\" (UniqueName: \"kubernetes.io/projected/4935f051-3669-406c-a548-9889b76b1b50-kube-api-access-fc6ls\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.054922 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.054672 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4935f051-3669-406c-a548-9889b76b1b50-tmp\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.054922 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.054709 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4935f051-3669-406c-a548-9889b76b1b50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.054922 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.054730 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4935f051-3669-406c-a548-9889b76b1b50-manifests\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.055242 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.055217 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/4935f051-3669-406c-a548-9889b76b1b50-manifests\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.057221 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.057194 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4935f051-3669-406c-a548-9889b76b1b50-tmp\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.057221 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.057210 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4935f051-3669-406c-a548-9889b76b1b50-webhook-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.057359 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.057343 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/4935f051-3669-406c-a548-9889b76b1b50-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.065404 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.065372 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.066651 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.066625 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fc6ls\" (UniqueName: \"kubernetes.io/projected/4935f051-3669-406c-a548-9889b76b1b50-kube-api-access-fc6ls\") pod \"opendatahub-operator-controller-manager-7ddf58f47c-5cd6f\" (UID: \"4935f051-3669-406c-a548-9889b76b1b50\") " pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.160918 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.160881 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:14.180618 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.180591 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.286755 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.286725 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.311812 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.311784 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f"] Jul 09 22:34:14.314908 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:34:14.314883 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4935f051_3669_406c_a548_9889b76b1b50.slice/crio-3fe5eb9610fb59bfd90f68ab720bbc70922c0dba23dd6fe9598bbbe65ad3cdec WatchSource:0}: Error finding container 3fe5eb9610fb59bfd90f68ab720bbc70922c0dba23dd6fe9598bbbe65ad3cdec: Status 404 returned error can't find the container with id 3fe5eb9610fb59bfd90f68ab720bbc70922c0dba23dd6fe9598bbbe65ad3cdec Jul 09 22:34:14.438812 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.438787 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.556632 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.556552 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.688274 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.688240 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.849346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.849263 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:14.995492 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:14.995424 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" event={"ID":"4935f051-3669-406c-a548-9889b76b1b50","Type":"ContainerStarted","Data":"3fe5eb9610fb59bfd90f68ab720bbc70922c0dba23dd6fe9598bbbe65ad3cdec"} Jul 09 22:34:15.193932 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:15.193895 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:15.313917 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:15.313852 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:18.008060 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:18.008027 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" event={"ID":"4935f051-3669-406c-a548-9889b76b1b50","Type":"ContainerStarted","Data":"81ae24a25a5057526d30ce3c087de5cff29cafb8c2f916b58202f1d225f5d9e7"} Jul 09 22:34:19.012975 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:19.012944 2552 generic.go:356] "Generic (PLEG): container finished" podID="4935f051-3669-406c-a548-9889b76b1b50" containerID="81ae24a25a5057526d30ce3c087de5cff29cafb8c2f916b58202f1d225f5d9e7" exitCode=0 Jul 09 22:34:19.013387 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:19.013030 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" event={"ID":"4935f051-3669-406c-a548-9889b76b1b50","Type":"ContainerDied","Data":"81ae24a25a5057526d30ce3c087de5cff29cafb8c2f916b58202f1d225f5d9e7"} Jul 09 22:34:20.020484 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:20.020444 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" event={"ID":"4935f051-3669-406c-a548-9889b76b1b50","Type":"ContainerStarted","Data":"c876fe9aa8edc1d2b5b97953d0d916ea0a7aea4833c0e1b32faf67fd8eebc547"} Jul 09 22:34:20.020857 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:20.020548 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:20.045859 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:20.045817 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" podStartSLOduration=2.633575885 podStartE2EDuration="7.04580437s" totalImagesPullingTime="3.328686137s" totalInitContainerRuntime="1.083542348s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:20.044047995 +0000 UTC m=+385.942830823" watchObservedRunningTime="2026-07-09 22:34:20.04580437 +0000 UTC m=+385.944587231" Jul 09 22:34:29.943319 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:29.943283 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:30.038950 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:30.038917 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:30.361004 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:30.360907 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:30.433170 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:30.433127 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:31.025384 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:31.025358 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7ddf58f47c-5cd6f" Jul 09 22:34:33.790611 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:33.790575 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:33.881674 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:33.881641 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:44.583803 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.583760 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:44.677898 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.677866 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-686787b779-2jl6h"] Jul 09 22:34:44.685834 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.685813 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.688209 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.688186 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 22:34:44.688373 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.688354 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 22:34:44.688435 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.688361 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 22:34:44.688435 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.688430 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 22:34:44.690250 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.690235 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jsgvq\"" Jul 09 22:34:44.693559 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.693536 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686787b779-2jl6h"] Jul 09 22:34:44.758243 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.758213 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1932766-3c84-4573-be38-b491079b0f84-tls-certs\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.758391 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.758277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltzcm\" (UniqueName: \"kubernetes.io/projected/d1932766-3c84-4573-be38-b491079b0f84-kube-api-access-ltzcm\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.758391 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.758325 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1932766-3c84-4573-be38-b491079b0f84-tmp\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.859499 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.859418 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltzcm\" (UniqueName: \"kubernetes.io/projected/d1932766-3c84-4573-be38-b491079b0f84-kube-api-access-ltzcm\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.859499 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.859455 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1932766-3c84-4573-be38-b491079b0f84-tmp\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.859499 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.859481 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1932766-3c84-4573-be38-b491079b0f84-tls-certs\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.859740 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:34:44.859566 2552 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 09 22:34:44.859740 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:34:44.859623 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d1932766-3c84-4573-be38-b491079b0f84-tls-certs podName:d1932766-3c84-4573-be38-b491079b0f84 nodeName:}" failed. No retries permitted until 2026-07-09 22:34:45.359608285 +0000 UTC m=+411.258391091 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d1932766-3c84-4573-be38-b491079b0f84-tls-certs") pod "kube-auth-proxy-686787b779-2jl6h" (UID: "d1932766-3c84-4573-be38-b491079b0f84") : secret "kube-auth-proxy-tls" not found Jul 09 22:34:44.861588 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.861568 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d1932766-3c84-4573-be38-b491079b0f84-tmp\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.885545 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.885519 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltzcm\" (UniqueName: \"kubernetes.io/projected/d1932766-3c84-4573-be38-b491079b0f84-kube-api-access-ltzcm\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:44.951617 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:44.951588 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:45.051503 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.051472 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:45.156869 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.156830 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:45.301554 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.301525 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:45.363899 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.363865 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1932766-3c84-4573-be38-b491079b0f84-tls-certs\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:45.366214 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.366199 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1932766-3c84-4573-be38-b491079b0f84-tls-certs\") pod \"kube-auth-proxy-686787b779-2jl6h\" (UID: \"d1932766-3c84-4573-be38-b491079b0f84\") " pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:45.595942 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.595864 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" Jul 09 22:34:45.720743 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.720713 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r2rg8"] Jul 09 22:34:45.724053 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.724035 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:45.731629 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.730876 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:45.741825 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.741804 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 09 22:34:45.741935 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.741813 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-hcwnm\"" Jul 09 22:34:45.742628 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:34:45.742606 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1932766_3c84_4573_be38_b491079b0f84.slice/crio-45d5e55d84ecf62461e734703b336f4bb9ff456a9852047a4896a25ec44bc440 WatchSource:0}: Error finding container 45d5e55d84ecf62461e734703b336f4bb9ff456a9852047a4896a25ec44bc440: Status 404 returned error can't find the container with id 45d5e55d84ecf62461e734703b336f4bb9ff456a9852047a4896a25ec44bc440 Jul 09 22:34:45.743243 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.743148 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-686787b779-2jl6h"] Jul 09 22:34:45.763525 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.763498 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r2rg8"] Jul 09 22:34:45.766338 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.766317 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-tls-certs\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:45.766447 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.766365 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mm52j\" (UniqueName: \"kubernetes.io/projected/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-kube-api-access-mm52j\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:45.867387 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.867317 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-tls-certs\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:45.867387 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.867355 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mm52j\" (UniqueName: \"kubernetes.io/projected/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-kube-api-access-mm52j\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:45.867556 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:34:45.867456 2552 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 09 22:34:45.867556 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:34:45.867515 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-tls-certs podName:1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80 nodeName:}" failed. No retries permitted until 2026-07-09 22:34:46.36749936 +0000 UTC m=+412.266282167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-tls-certs") pod "model-serving-api-54d89bd5fc-r2rg8" (UID: "1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80") : secret "model-serving-api-tls" not found Jul 09 22:34:45.882375 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:45.882350 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mm52j\" (UniqueName: \"kubernetes.io/projected/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-kube-api-access-mm52j\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:46.103825 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.103791 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" event={"ID":"d1932766-3c84-4573-be38-b491079b0f84","Type":"ContainerStarted","Data":"45d5e55d84ecf62461e734703b336f4bb9ff456a9852047a4896a25ec44bc440"} Jul 09 22:34:46.115694 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.115666 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:46.316676 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.316647 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:46.371836 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.371809 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-tls-certs\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:46.374144 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.374117 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80-tls-certs\") pod \"model-serving-api-54d89bd5fc-r2rg8\" (UID: \"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80\") " pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:46.418588 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.418559 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:46.634731 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.634669 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:46.784228 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:46.784195 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-r2rg8"] Jul 09 22:34:47.108044 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:47.107965 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" event={"ID":"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80","Type":"ContainerStarted","Data":"c4aaba430e37226b9ba16dc78cd7ec31280c7d760367631f3c08108e4772171f"} Jul 09 22:34:47.489744 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:47.489704 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:48.858573 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:48.858546 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:48.918832 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:48.918806 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:49.117497 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:49.117426 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" event={"ID":"d1932766-3c84-4573-be38-b491079b0f84","Type":"ContainerStarted","Data":"e6e85470456d97d01c679fb26cb26090791429c9c24f59369b56f6e07f7b3a9c"} Jul 09 22:34:49.118884 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:49.118863 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" event={"ID":"1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80","Type":"ContainerStarted","Data":"e018f17e9d7353bb71657fce95da9cf7853e3339f06cc44a8f9714cf9d69372e"} Jul 09 22:34:49.119011 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:49.118992 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:34:49.135174 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:49.135127 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-686787b779-2jl6h" podStartSLOduration=2.108603052 podStartE2EDuration="5.135113396s" totalImagesPullingTime="3.026510344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:49.133694714 +0000 UTC m=+415.032477554" watchObservedRunningTime="2026-07-09 22:34:49.135113396 +0000 UTC m=+415.033896248" Jul 09 22:34:49.150532 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:49.150488 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" podStartSLOduration=2.167536625 podStartE2EDuration="4.150476123s" totalImagesPullingTime="1.982939498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:49.149459835 +0000 UTC m=+415.048242699" watchObservedRunningTime="2026-07-09 22:34:49.150476123 +0000 UTC m=+415.049258951" Jul 09 22:34:52.114471 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.114436 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:52.220503 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.220471 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:52.442624 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.442589 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd"] Jul 09 22:34:52.452366 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.452338 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.455197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.455177 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 22:34:52.455197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.455191 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 22:34:52.455336 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.455176 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-kmrqg\"" Jul 09 22:34:52.455336 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.455284 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 22:34:52.455855 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.455838 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 22:34:52.463421 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.463401 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd"] Jul 09 22:34:52.517523 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517495 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9754815-6caf-4abb-96db-88f833fe632b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.517640 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517542 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.517640 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517606 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2f62\" (UniqueName: \"kubernetes.io/projected/e9754815-6caf-4abb-96db-88f833fe632b-kube-api-access-q2f62\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.517751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517641 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9754815-6caf-4abb-96db-88f833fe632b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.517751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517665 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.517751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517700 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9754815-6caf-4abb-96db-88f833fe632b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.517751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.517731 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.618647 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.618621 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9754815-6caf-4abb-96db-88f833fe632b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.618759 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.618744 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.618805 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.618775 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9754815-6caf-4abb-96db-88f833fe632b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.618805 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.618793 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.618868 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.618845 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9754815-6caf-4abb-96db-88f833fe632b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.618902 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.618888 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.619090 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.619059 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2f62\" (UniqueName: \"kubernetes.io/projected/e9754815-6caf-4abb-96db-88f833fe632b-kube-api-access-q2f62\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.619627 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.619571 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e9754815-6caf-4abb-96db-88f833fe632b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.621245 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.621217 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.621333 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.621219 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.621418 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.621402 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e9754815-6caf-4abb-96db-88f833fe632b-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.621530 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.621515 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e9754815-6caf-4abb-96db-88f833fe632b-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.638594 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.638569 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2f62\" (UniqueName: \"kubernetes.io/projected/e9754815-6caf-4abb-96db-88f833fe632b-kube-api-access-q2f62\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.639078 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.639062 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e9754815-6caf-4abb-96db-88f833fe632b-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-km8fd\" (UID: \"e9754815-6caf-4abb-96db-88f833fe632b\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.761108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.761046 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:52.895274 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:52.895251 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd"] Jul 09 22:34:52.896663 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:34:52.896635 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9754815_6caf_4abb_96db_88f833fe632b.slice/crio-ecb3a401bbf72aa4808d859e6cfeafe99ef3ee16e63dc06822156d6e67b7595e WatchSource:0}: Error finding container ecb3a401bbf72aa4808d859e6cfeafe99ef3ee16e63dc06822156d6e67b7595e: Status 404 returned error can't find the container with id ecb3a401bbf72aa4808d859e6cfeafe99ef3ee16e63dc06822156d6e67b7595e Jul 09 22:34:53.001876 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:53.001840 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:53.132426 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:53.132386 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" event={"ID":"e9754815-6caf-4abb-96db-88f833fe632b","Type":"ContainerStarted","Data":"ecb3a401bbf72aa4808d859e6cfeafe99ef3ee16e63dc06822156d6e67b7595e"} Jul 09 22:34:53.209070 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:53.209040 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:53.396621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:53.396548 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:55.184343 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.184300 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:34:55.184653 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.184371 2552 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 22:34:55.502285 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.502200 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:55.570284 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.570238 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx"] Jul 09 22:34:55.573839 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.573818 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.576419 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.576399 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-47xsc\"" Jul 09 22:34:55.576668 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.576649 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 09 22:34:55.588426 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.588399 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx"] Jul 09 22:34:55.602962 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.602933 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:55.643544 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.643511 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1d28b8-d682-471a-b6ae-d30b251d534f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fflx\" (UID: \"0d1d28b8-d682-471a-b6ae-d30b251d534f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.643668 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.643573 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9jp6\" (UniqueName: \"kubernetes.io/projected/0d1d28b8-d682-471a-b6ae-d30b251d534f-kube-api-access-w9jp6\") pod \"llmisvc-controller-manager-777c6bd7d5-9fflx\" (UID: \"0d1d28b8-d682-471a-b6ae-d30b251d534f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.676767 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.676738 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:55.744916 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.744884 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1d28b8-d682-471a-b6ae-d30b251d534f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fflx\" (UID: \"0d1d28b8-d682-471a-b6ae-d30b251d534f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.745061 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.744944 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9jp6\" (UniqueName: \"kubernetes.io/projected/0d1d28b8-d682-471a-b6ae-d30b251d534f-kube-api-access-w9jp6\") pod \"llmisvc-controller-manager-777c6bd7d5-9fflx\" (UID: \"0d1d28b8-d682-471a-b6ae-d30b251d534f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.747208 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.747188 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0d1d28b8-d682-471a-b6ae-d30b251d534f-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-9fflx\" (UID: \"0d1d28b8-d682-471a-b6ae-d30b251d534f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.764655 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.764599 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9jp6\" (UniqueName: \"kubernetes.io/projected/0d1d28b8-d682-471a-b6ae-d30b251d534f-kube-api-access-w9jp6\") pod \"llmisvc-controller-manager-777c6bd7d5-9fflx\" (UID: \"0d1d28b8-d682-471a-b6ae-d30b251d534f\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.818549 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.818524 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:55.885799 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.885760 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:55.931030 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:55.931000 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:56.025431 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.025408 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx"] Jul 09 22:34:56.027495 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:34:56.027471 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0d1d28b8_d682_471a_b6ae_d30b251d534f.slice/crio-1e9b93c24ec0a5b7570437bced0f0255785bee46ab494ee13485541b7e1a60cc WatchSource:0}: Error finding container 1e9b93c24ec0a5b7570437bced0f0255785bee46ab494ee13485541b7e1a60cc: Status 404 returned error can't find the container with id 1e9b93c24ec0a5b7570437bced0f0255785bee46ab494ee13485541b7e1a60cc Jul 09 22:34:56.101457 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.101431 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:34:56.147492 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.147437 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" event={"ID":"e9754815-6caf-4abb-96db-88f833fe632b","Type":"ContainerStarted","Data":"0b47926e61d5e949396467699dec59b1553295af0fccfea1d2c85988956775cb"} Jul 09 22:34:56.147802 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.147777 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:56.149031 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.149001 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" event={"ID":"0d1d28b8-d682-471a-b6ae-d30b251d534f","Type":"ContainerStarted","Data":"1e9b93c24ec0a5b7570437bced0f0255785bee46ab494ee13485541b7e1a60cc"} Jul 09 22:34:56.149722 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.149696 2552 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-km8fd container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 22:34:56.149825 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.149756 2552 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" podUID="e9754815-6caf-4abb-96db-88f833fe632b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 22:34:56.176447 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:56.176392 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" podStartSLOduration=1.89096883 podStartE2EDuration="4.176374933s" totalImagesPullingTime="2.285406103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:56.174593659 +0000 UTC m=+422.073376496" watchObservedRunningTime="2026-07-09 22:34:56.176374933 +0000 UTC m=+422.075157761" Jul 09 22:34:57.154948 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:57.154916 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-km8fd" Jul 09 22:34:59.164487 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:59.164455 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" event={"ID":"0d1d28b8-d682-471a-b6ae-d30b251d534f","Type":"ContainerStarted","Data":"d5f8e09af380e8e240915bb998d2b145fe2dddb8aecfed17e71805174e72e4e2"} Jul 09 22:34:59.164864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:59.164540 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:34:59.198413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:34:59.198331 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" podStartSLOduration=1.287320465 podStartE2EDuration="4.198316798s" totalImagesPullingTime="2.910996333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:34:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:34:59.197843355 +0000 UTC m=+425.096626183" watchObservedRunningTime="2026-07-09 22:34:59.198316798 +0000 UTC m=+425.097099633" Jul 09 22:35:00.126631 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:00.126601 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-r2rg8" Jul 09 22:35:28.545057 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:28.544986 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:28.646587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:28.646561 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:30.171259 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:30.171224 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-9fflx" Jul 09 22:35:35.464380 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:35.464346 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:35.644325 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:35.644295 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:35.732612 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:35.732525 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:48.373259 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:48.373224 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:48.472978 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:48.472951 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:48.543831 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:48.543798 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:49.061084 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:49.061049 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:49.127383 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:49.127349 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:59.692710 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:59.692679 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:59.798755 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:59.798722 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:35:59.899561 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:35:59.899533 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:13.030608 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:13.030570 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:16.511059 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:16.511027 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:17.252092 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:17.252060 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:19.836956 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.836922 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc"] Jul 09 22:36:19.840693 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.840667 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:19.843770 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.843744 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 22:36:19.843941 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.843920 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-pjxtc\"" Jul 09 22:36:19.844735 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.844718 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 22:36:19.853053 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.853022 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc"] Jul 09 22:36:19.949180 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:19.949130 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xg7\" (UniqueName: \"kubernetes.io/projected/3afc2cf3-4e1e-4be9-8390-92edfa84dd64-kube-api-access-64xg7\") pod \"authorino-operator-75cc8d5cb7-vkhsc\" (UID: \"3afc2cf3-4e1e-4be9-8390-92edfa84dd64\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:20.049643 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.049612 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xg7\" (UniqueName: \"kubernetes.io/projected/3afc2cf3-4e1e-4be9-8390-92edfa84dd64-kube-api-access-64xg7\") pod \"authorino-operator-75cc8d5cb7-vkhsc\" (UID: \"3afc2cf3-4e1e-4be9-8390-92edfa84dd64\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:20.058601 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.058570 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xg7\" (UniqueName: \"kubernetes.io/projected/3afc2cf3-4e1e-4be9-8390-92edfa84dd64-kube-api-access-64xg7\") pod \"authorino-operator-75cc8d5cb7-vkhsc\" (UID: \"3afc2cf3-4e1e-4be9-8390-92edfa84dd64\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:20.152595 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.152571 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:20.292070 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.291889 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc"] Jul 09 22:36:20.294676 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:36:20.294651 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afc2cf3_4e1e_4be9_8390_92edfa84dd64.slice/crio-f87a608ce5cad96b6646d3007b4e5608c1d5e7d4905fbc3a44be9a346d9dbf89 WatchSource:0}: Error finding container f87a608ce5cad96b6646d3007b4e5608c1d5e7d4905fbc3a44be9a346d9dbf89: Status 404 returned error can't find the container with id f87a608ce5cad96b6646d3007b4e5608c1d5e7d4905fbc3a44be9a346d9dbf89 Jul 09 22:36:20.449587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.449523 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" event={"ID":"3afc2cf3-4e1e-4be9-8390-92edfa84dd64","Type":"ContainerStarted","Data":"f87a608ce5cad96b6646d3007b4e5608c1d5e7d4905fbc3a44be9a346d9dbf89"} Jul 09 22:36:20.555135 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.555108 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:20.660407 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.660379 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:20.809257 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:20.809152 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:23.282548 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:23.282515 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:23.465769 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:23.465735 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" event={"ID":"3afc2cf3-4e1e-4be9-8390-92edfa84dd64","Type":"ContainerStarted","Data":"25fee635c5c133e4a19af73825bfa2ef7caf075e70a27fde48a84db188a9e0c0"} Jul 09 22:36:23.465949 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:23.465844 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:23.508353 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:23.508298 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" podStartSLOduration=2.220178764 podStartE2EDuration="4.508278755s" totalImagesPullingTime="2.288099991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:23.507187589 +0000 UTC m=+509.405970409" watchObservedRunningTime="2026-07-09 22:36:23.508278755 +0000 UTC m=+509.407061587" Jul 09 22:36:25.114392 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:25.114357 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:26.040419 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:26.040388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:28.076220 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.076176 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst"] Jul 09 22:36:28.079510 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.079490 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:28.082153 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.082129 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-bvm2m\"" Jul 09 22:36:28.082413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.082398 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 09 22:36:28.091730 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.091706 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst"] Jul 09 22:36:28.114684 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.114640 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wpvj4\" (UniqueName: \"kubernetes.io/projected/caa57e68-7574-4527-900e-dfbd2c2ee65e-kube-api-access-wpvj4\") pod \"dns-operator-controller-manager-864dd78c4c-cmkst\" (UID: \"caa57e68-7574-4527-900e-dfbd2c2ee65e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:28.215734 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.215698 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wpvj4\" (UniqueName: \"kubernetes.io/projected/caa57e68-7574-4527-900e-dfbd2c2ee65e-kube-api-access-wpvj4\") pod \"dns-operator-controller-manager-864dd78c4c-cmkst\" (UID: \"caa57e68-7574-4527-900e-dfbd2c2ee65e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:28.230513 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.230480 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wpvj4\" (UniqueName: \"kubernetes.io/projected/caa57e68-7574-4527-900e-dfbd2c2ee65e-kube-api-access-wpvj4\") pod \"dns-operator-controller-manager-864dd78c4c-cmkst\" (UID: \"caa57e68-7574-4527-900e-dfbd2c2ee65e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:28.279079 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.279051 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:28.389524 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.389496 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:28.518973 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:28.518950 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst"] Jul 09 22:36:28.521081 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:36:28.521054 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa57e68_7574_4527_900e_dfbd2c2ee65e.slice/crio-31657ac8e3d8ab17604de92a1d915e28a128ae72c9a4e5b31d038d0f2bd11028 WatchSource:0}: Error finding container 31657ac8e3d8ab17604de92a1d915e28a128ae72c9a4e5b31d038d0f2bd11028: Status 404 returned error can't find the container with id 31657ac8e3d8ab17604de92a1d915e28a128ae72c9a4e5b31d038d0f2bd11028 Jul 09 22:36:29.491335 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:29.491303 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" event={"ID":"caa57e68-7574-4527-900e-dfbd2c2ee65e","Type":"ContainerStarted","Data":"31657ac8e3d8ab17604de92a1d915e28a128ae72c9a4e5b31d038d0f2bd11028"} Jul 09 22:36:30.082129 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:30.082098 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:30.228726 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:30.228687 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:31.501726 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:31.501641 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" event={"ID":"caa57e68-7574-4527-900e-dfbd2c2ee65e","Type":"ContainerStarted","Data":"e34c5a6490bc04d3a3805956beda697ad9a7cf5556d6522182337f19a3d97a56"} Jul 09 22:36:31.502083 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:31.501778 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:31.528300 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:31.528240 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" podStartSLOduration=0.813209265 podStartE2EDuration="3.528221355s" totalImagesPullingTime="2.71501209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:31.527188844 +0000 UTC m=+517.425971664" watchObservedRunningTime="2026-07-09 22:36:31.528221355 +0000 UTC m=+517.427004183" Jul 09 22:36:33.571154 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:33.571116 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:33.784528 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:33.784485 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:34.029055 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:34.028998 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:34.088266 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:34.088221 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:34.423448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:34.423404 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:34.472454 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:34.472427 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-vkhsc" Jul 09 22:36:34.484859 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:34.484815 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:38.439552 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:38.439516 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:38.541988 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:38.541950 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:42.507910 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:42.507877 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-cmkst" Jul 09 22:36:42.953846 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:42.953810 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:44.342445 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.342408 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968"] Jul 09 22:36:44.346055 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.346034 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.348440 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.348421 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-2vbvv\"" Jul 09 22:36:44.358062 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.358036 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968"] Jul 09 22:36:44.447956 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.447924 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmfqt\" (UniqueName: \"kubernetes.io/projected/4e88d4ae-228e-41f3-8821-9c5c408002ba-kube-api-access-kmfqt\") pod \"kuadrant-operator-controller-manager-55467d9f7-g9968\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.448139 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.447993 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e88d4ae-228e-41f3-8821-9c5c408002ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-g9968\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.467992 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.467960 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968"] Jul 09 22:36:44.468216 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:44.468198 2552 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-kmfqt], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" podUID="4e88d4ae-228e-41f3-8821-9c5c408002ba" Jul 09 22:36:44.549233 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.549201 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmfqt\" (UniqueName: \"kubernetes.io/projected/4e88d4ae-228e-41f3-8821-9c5c408002ba-kube-api-access-kmfqt\") pod \"kuadrant-operator-controller-manager-55467d9f7-g9968\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.549400 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.549268 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e88d4ae-228e-41f3-8821-9c5c408002ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-g9968\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.549626 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.549610 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e88d4ae-228e-41f3-8821-9c5c408002ba-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-g9968\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.556433 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.556407 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.563178 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.563144 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.564316 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.564295 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968"] Jul 09 22:36:44.570654 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.570620 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmfqt\" (UniqueName: \"kubernetes.io/projected/4e88d4ae-228e-41f3-8821-9c5c408002ba-kube-api-access-kmfqt\") pod \"kuadrant-operator-controller-manager-55467d9f7-g9968\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.572235 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.572211 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968"] Jul 09 22:36:44.583578 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:44.583537 2552 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"4e88d4ae-228e-41f3-8821-9c5c408002ba\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-55467d9f7-g9968\": pods \"kuadrant-operator-controller-manager-55467d9f7-g9968\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.585868 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:44.585835 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g9968\" is forbidden: User \"system:node:ip-10-0-139-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-240.ec2.internal' and this object" podUID="4e88d4ae-228e-41f3-8821-9c5c408002ba" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.613314 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.613235 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk"] Jul 09 22:36:44.616599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.616576 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.620902 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:44.620868 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g9968\" is forbidden: User \"system:node:ip-10-0-139-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-240.ec2.internal' and this object" podUID="4e88d4ae-228e-41f3-8821-9c5c408002ba" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:44.637797 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.637763 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk"] Jul 09 22:36:44.650119 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.650087 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmfqt\" (UniqueName: \"kubernetes.io/projected/4e88d4ae-228e-41f3-8821-9c5c408002ba-kube-api-access-kmfqt\") pod \"4e88d4ae-228e-41f3-8821-9c5c408002ba\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " Jul 09 22:36:44.650286 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.650230 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e88d4ae-228e-41f3-8821-9c5c408002ba-extensions-socket-volume\") pod \"4e88d4ae-228e-41f3-8821-9c5c408002ba\" (UID: \"4e88d4ae-228e-41f3-8821-9c5c408002ba\") " Jul 09 22:36:44.650692 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.650659 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4e88d4ae-228e-41f3-8821-9c5c408002ba-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4e88d4ae-228e-41f3-8821-9c5c408002ba" (UID: "4e88d4ae-228e-41f3-8821-9c5c408002ba"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:36:44.652588 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.652566 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e88d4ae-228e-41f3-8821-9c5c408002ba-kube-api-access-kmfqt" (OuterVolumeSpecName: "kube-api-access-kmfqt") pod "4e88d4ae-228e-41f3-8821-9c5c408002ba" (UID: "4e88d4ae-228e-41f3-8821-9c5c408002ba"). InnerVolumeSpecName "kube-api-access-kmfqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:36:44.751260 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.751214 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmzwk\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.751260 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.751266 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-kube-api-access-lvvsf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmzwk\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.751483 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.751382 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e88d4ae-228e-41f3-8821-9c5c408002ba-extensions-socket-volume\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:36:44.751483 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.751402 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmfqt\" (UniqueName: \"kubernetes.io/projected/4e88d4ae-228e-41f3-8821-9c5c408002ba-kube-api-access-kmfqt\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:36:44.851890 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.851844 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmzwk\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.852079 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.851919 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-kube-api-access-lvvsf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmzwk\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.852289 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.852268 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmzwk\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.865609 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.865546 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-kube-api-access-lvvsf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hmzwk\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:44.927236 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:44.927207 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:45.068532 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:45.068497 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk"] Jul 09 22:36:45.071851 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:36:45.071827 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9d20f91_fe67_4cb3_abc0_0bb875d20c43.slice/crio-09e0c3fabdea2a836cdb448c5e31ba6c173b678630274f846650d076323318e2 WatchSource:0}: Error finding container 09e0c3fabdea2a836cdb448c5e31ba6c173b678630274f846650d076323318e2: Status 404 returned error can't find the container with id 09e0c3fabdea2a836cdb448c5e31ba6c173b678630274f846650d076323318e2 Jul 09 22:36:45.562298 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:45.562265 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:45.562767 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:45.562310 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" event={"ID":"f9d20f91-fe67-4cb3-abc0-0bb875d20c43","Type":"ContainerStarted","Data":"09e0c3fabdea2a836cdb448c5e31ba6c173b678630274f846650d076323318e2"} Jul 09 22:36:45.565379 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:45.565334 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g9968\" is forbidden: User \"system:node:ip-10-0-139-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-240.ec2.internal' and this object" podUID="4e88d4ae-228e-41f3-8821-9c5c408002ba" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:45.570691 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:45.570656 2552 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-g9968\" is forbidden: User \"system:node:ip-10-0-139-240.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-240.ec2.internal' and this object" podUID="4e88d4ae-228e-41f3-8821-9c5c408002ba" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-g9968" Jul 09 22:36:46.545270 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:46.545238 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e88d4ae-228e-41f3-8821-9c5c408002ba" path="/var/lib/kubelet/pods/4e88d4ae-228e-41f3-8821-9c5c408002ba/volumes" Jul 09 22:36:47.880071 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:47.880039 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:47.982788 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:47.982742 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:50.588419 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:50.588381 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" event={"ID":"f9d20f91-fe67-4cb3-abc0-0bb875d20c43","Type":"ContainerStarted","Data":"a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388"} Jul 09 22:36:50.588821 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:50.588518 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:50.608349 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:50.608295 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" podStartSLOduration=1.869994433 podStartE2EDuration="6.608279475s" totalImagesPullingTime="4.738285042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:36:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:36:50.606721908 +0000 UTC m=+536.505504748" watchObservedRunningTime="2026-07-09 22:36:50.608279475 +0000 UTC m=+536.507062302" Jul 09 22:36:51.673135 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:51.673098 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:51.803913 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:51.803882 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:56.851197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:56.851146 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk"] Jul 09 22:36:56.851606 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:56.851394 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" podUID="f9d20f91-fe67-4cb3-abc0-0bb875d20c43" containerName="manager" containerID="cri-o://a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388" gracePeriod=10 Jul 09 22:36:56.853313 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:56.853285 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:57.101339 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.101276 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:57.109477 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.109445 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:57.212061 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.212030 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:57.255009 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.254978 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-kube-api-access-lvvsf\") pod \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " Jul 09 22:36:57.255202 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.255033 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-extensions-socket-volume\") pod \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\" (UID: \"f9d20f91-fe67-4cb3-abc0-0bb875d20c43\") " Jul 09 22:36:57.255470 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.255447 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f9d20f91-fe67-4cb3-abc0-0bb875d20c43" (UID: "f9d20f91-fe67-4cb3-abc0-0bb875d20c43"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 22:36:57.257332 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.257311 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-kube-api-access-lvvsf" (OuterVolumeSpecName: "kube-api-access-lvvsf") pod "f9d20f91-fe67-4cb3-abc0-0bb875d20c43" (UID: "f9d20f91-fe67-4cb3-abc0-0bb875d20c43"). InnerVolumeSpecName "kube-api-access-lvvsf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:36:57.356019 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.355920 2552 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-extensions-socket-volume\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:36:57.356019 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.355961 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvvsf\" (UniqueName: \"kubernetes.io/projected/f9d20f91-fe67-4cb3-abc0-0bb875d20c43-kube-api-access-lvvsf\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:36:57.461768 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.461735 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:57.558728 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.558699 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:36:57.615661 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.615568 2552 generic.go:356] "Generic (PLEG): container finished" podID="f9d20f91-fe67-4cb3-abc0-0bb875d20c43" containerID="a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388" exitCode=0 Jul 09 22:36:57.615661 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.615609 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" Jul 09 22:36:57.615849 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.615658 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" event={"ID":"f9d20f91-fe67-4cb3-abc0-0bb875d20c43","Type":"ContainerDied","Data":"a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388"} Jul 09 22:36:57.615849 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.615708 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk" event={"ID":"f9d20f91-fe67-4cb3-abc0-0bb875d20c43","Type":"ContainerDied","Data":"09e0c3fabdea2a836cdb448c5e31ba6c173b678630274f846650d076323318e2"} Jul 09 22:36:57.615849 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.615732 2552 scope.go:117] "RemoveContainer" containerID="a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388" Jul 09 22:36:57.624610 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.624587 2552 scope.go:117] "RemoveContainer" containerID="a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388" Jul 09 22:36:57.624886 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:36:57.624869 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388\": container with ID starting with a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388 not found: ID does not exist" containerID="a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388" Jul 09 22:36:57.624946 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.624893 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388"} err="failed to get container status \"a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388\": rpc error: code = NotFound desc = could not find container \"a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388\": container with ID starting with a3ce84a7ed7c64aba4d8f1000fc898fbe8ae3c83238d6245162f7215a2c5b388 not found: ID does not exist" Jul 09 22:36:57.638420 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.638387 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk"] Jul 09 22:36:57.645286 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:57.645258 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hmzwk"] Jul 09 22:36:58.542534 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:36:58.542491 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9d20f91-fe67-4cb3-abc0-0bb875d20c43" path="/var/lib/kubelet/pods/f9d20f91-fe67-4cb3-abc0-0bb875d20c43/volumes" Jul 09 22:37:01.054674 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:01.054630 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:01.123672 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:01.123640 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:06.966139 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:06.966100 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:07.066940 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:07.066905 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:13.202891 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:13.202851 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:13.361891 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:13.361853 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:14.923577 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.923534 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:14.927498 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.925385 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:14.927498 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.925999 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9d20f91-fe67-4cb3-abc0-0bb875d20c43" containerName="manager" Jul 09 22:37:14.927498 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.926017 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9d20f91-fe67-4cb3-abc0-0bb875d20c43" containerName="manager" Jul 09 22:37:14.927498 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.926181 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9d20f91-fe67-4cb3-abc0-0bb875d20c43" containerName="manager" Jul 09 22:37:14.932389 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.932361 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:14.935543 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.935518 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 22:37:14.935678 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.935641 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qjbs5\"" Jul 09 22:37:14.936225 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:14.936203 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:15.000362 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.000329 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wpd5\" (UniqueName: \"kubernetes.io/projected/944e6a1b-c0ff-48a6-8695-6348d6992ef7-kube-api-access-8wpd5\") pod \"limitador-limitador-64c94fd64f-lxsxz\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.000572 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.000380 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/944e6a1b-c0ff-48a6-8695-6348d6992ef7-config-file\") pod \"limitador-limitador-64c94fd64f-lxsxz\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.026660 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.026625 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:15.031782 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.031742 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:15.089510 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.089476 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:15.100777 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.100748 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wpd5\" (UniqueName: \"kubernetes.io/projected/944e6a1b-c0ff-48a6-8695-6348d6992ef7-kube-api-access-8wpd5\") pod \"limitador-limitador-64c94fd64f-lxsxz\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.100931 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.100790 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/944e6a1b-c0ff-48a6-8695-6348d6992ef7-config-file\") pod \"limitador-limitador-64c94fd64f-lxsxz\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.101493 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.101474 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/944e6a1b-c0ff-48a6-8695-6348d6992ef7-config-file\") pod \"limitador-limitador-64c94fd64f-lxsxz\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.108805 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.108786 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wpd5\" (UniqueName: \"kubernetes.io/projected/944e6a1b-c0ff-48a6-8695-6348d6992ef7-kube-api-access-8wpd5\") pod \"limitador-limitador-64c94fd64f-lxsxz\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.244177 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.244076 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:15.376530 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.376491 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:15.379631 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:37:15.379606 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod944e6a1b_c0ff_48a6_8695_6348d6992ef7.slice/crio-897e801795904c106bc524fb6e6c5475706bdc7a99fba87aeafa5d140e4eaac4 WatchSource:0}: Error finding container 897e801795904c106bc524fb6e6c5475706bdc7a99fba87aeafa5d140e4eaac4: Status 404 returned error can't find the container with id 897e801795904c106bc524fb6e6c5475706bdc7a99fba87aeafa5d140e4eaac4 Jul 09 22:37:15.691197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.691143 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" event={"ID":"944e6a1b-c0ff-48a6-8695-6348d6992ef7","Type":"ContainerStarted","Data":"897e801795904c106bc524fb6e6c5475706bdc7a99fba87aeafa5d140e4eaac4"} Jul 09 22:37:15.757048 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.757011 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:15.820599 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:15.820561 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:18.707346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:18.707308 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" event={"ID":"944e6a1b-c0ff-48a6-8695-6348d6992ef7","Type":"ContainerStarted","Data":"4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d"} Jul 09 22:37:18.707761 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:18.707385 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:18.722315 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:18.722265 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" podStartSLOduration=2.088116923 podStartE2EDuration="4.722251693s" totalImagesPullingTime="2.63413477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:18.722087147 +0000 UTC m=+564.620869976" watchObservedRunningTime="2026-07-09 22:37:18.722251693 +0000 UTC m=+564.621034520" Jul 09 22:37:24.906532 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:24.906494 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:24.963056 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:24.963004 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:29.712468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:29.712434 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:30.015678 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.015580 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:30.015869 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.015805 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" podUID="944e6a1b-c0ff-48a6-8695-6348d6992ef7" containerName="limitador" containerID="cri-o://4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d" gracePeriod=30 Jul 09 22:37:30.566938 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.566914 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:30.624285 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.624208 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/944e6a1b-c0ff-48a6-8695-6348d6992ef7-config-file\") pod \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " Jul 09 22:37:30.624429 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.624308 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wpd5\" (UniqueName: \"kubernetes.io/projected/944e6a1b-c0ff-48a6-8695-6348d6992ef7-kube-api-access-8wpd5\") pod \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\" (UID: \"944e6a1b-c0ff-48a6-8695-6348d6992ef7\") " Jul 09 22:37:30.624606 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.624587 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/944e6a1b-c0ff-48a6-8695-6348d6992ef7-config-file" (OuterVolumeSpecName: "config-file") pod "944e6a1b-c0ff-48a6-8695-6348d6992ef7" (UID: "944e6a1b-c0ff-48a6-8695-6348d6992ef7"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:37:30.626332 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.626308 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/944e6a1b-c0ff-48a6-8695-6348d6992ef7-kube-api-access-8wpd5" (OuterVolumeSpecName: "kube-api-access-8wpd5") pod "944e6a1b-c0ff-48a6-8695-6348d6992ef7" (UID: "944e6a1b-c0ff-48a6-8695-6348d6992ef7"). InnerVolumeSpecName "kube-api-access-8wpd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:37:30.725868 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.725827 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wpd5\" (UniqueName: \"kubernetes.io/projected/944e6a1b-c0ff-48a6-8695-6348d6992ef7-kube-api-access-8wpd5\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:37:30.725868 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.725864 2552 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/944e6a1b-c0ff-48a6-8695-6348d6992ef7-config-file\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:37:30.756568 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.756530 2552 generic.go:356] "Generic (PLEG): container finished" podID="944e6a1b-c0ff-48a6-8695-6348d6992ef7" containerID="4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d" exitCode=0 Jul 09 22:37:30.756738 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.756584 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" Jul 09 22:37:30.756738 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.756626 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" event={"ID":"944e6a1b-c0ff-48a6-8695-6348d6992ef7","Type":"ContainerDied","Data":"4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d"} Jul 09 22:37:30.756738 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.756681 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-lxsxz" event={"ID":"944e6a1b-c0ff-48a6-8695-6348d6992ef7","Type":"ContainerDied","Data":"897e801795904c106bc524fb6e6c5475706bdc7a99fba87aeafa5d140e4eaac4"} Jul 09 22:37:30.756738 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.756703 2552 scope.go:117] "RemoveContainer" containerID="4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d" Jul 09 22:37:30.765355 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.765338 2552 scope.go:117] "RemoveContainer" containerID="4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d" Jul 09 22:37:30.765591 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:37:30.765574 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d\": container with ID starting with 4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d not found: ID does not exist" containerID="4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d" Jul 09 22:37:30.765640 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.765599 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d"} err="failed to get container status \"4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d\": rpc error: code = NotFound desc = could not find container \"4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d\": container with ID starting with 4aa7988403dd16bd03c641f97779c9a6a717f6967fc9f813698355e81710e61d not found: ID does not exist" Jul 09 22:37:30.777562 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.777538 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:30.781595 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:30.781574 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-lxsxz"] Jul 09 22:37:31.021491 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.021459 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:31.178040 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.177999 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:31.463050 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.463018 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2"] Jul 09 22:37:31.463325 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.463312 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="944e6a1b-c0ff-48a6-8695-6348d6992ef7" containerName="limitador" Jul 09 22:37:31.463372 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.463328 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="944e6a1b-c0ff-48a6-8695-6348d6992ef7" containerName="limitador" Jul 09 22:37:31.463410 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.463391 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="944e6a1b-c0ff-48a6-8695-6348d6992ef7" containerName="limitador" Jul 09 22:37:31.466845 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.466824 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.469415 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.469389 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 09 22:37:31.470117 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.470098 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 09 22:37:31.470238 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.470132 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-pqbxt\"" Jul 09 22:37:31.470238 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.470107 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 09 22:37:31.474504 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.474200 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2"] Jul 09 22:37:31.501528 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.501500 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:31.532322 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.532288 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bbzn\" (UniqueName: \"kubernetes.io/projected/a099618b-0f06-41c5-8121-27d5d63325d6-kube-api-access-5bbzn\") pod \"postgres-69fb4594cf-mkzv2\" (UID: \"a099618b-0f06-41c5-8121-27d5d63325d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.532447 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.532352 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a099618b-0f06-41c5-8121-27d5d63325d6-data\") pod \"postgres-69fb4594cf-mkzv2\" (UID: \"a099618b-0f06-41c5-8121-27d5d63325d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.638720 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.634296 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a099618b-0f06-41c5-8121-27d5d63325d6-data\") pod \"postgres-69fb4594cf-mkzv2\" (UID: \"a099618b-0f06-41c5-8121-27d5d63325d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.638720 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.634430 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bbzn\" (UniqueName: \"kubernetes.io/projected/a099618b-0f06-41c5-8121-27d5d63325d6-kube-api-access-5bbzn\") pod \"postgres-69fb4594cf-mkzv2\" (UID: \"a099618b-0f06-41c5-8121-27d5d63325d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.638720 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.635184 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/a099618b-0f06-41c5-8121-27d5d63325d6-data\") pod \"postgres-69fb4594cf-mkzv2\" (UID: \"a099618b-0f06-41c5-8121-27d5d63325d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.643939 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.643913 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bbzn\" (UniqueName: \"kubernetes.io/projected/a099618b-0f06-41c5-8121-27d5d63325d6-kube-api-access-5bbzn\") pod \"postgres-69fb4594cf-mkzv2\" (UID: \"a099618b-0f06-41c5-8121-27d5d63325d6\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.778200 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.778080 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:31.909332 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:31.909308 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2"] Jul 09 22:37:31.911267 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:37:31.911239 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda099618b_0f06_41c5_8121_27d5d63325d6.slice/crio-e7df532001a7238fc40bc003bd34215ab47c5a4de8b6634947e38ebd563b39ac WatchSource:0}: Error finding container e7df532001a7238fc40bc003bd34215ab47c5a4de8b6634947e38ebd563b39ac: Status 404 returned error can't find the container with id e7df532001a7238fc40bc003bd34215ab47c5a4de8b6634947e38ebd563b39ac Jul 09 22:37:32.542891 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:32.542845 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="944e6a1b-c0ff-48a6-8695-6348d6992ef7" path="/var/lib/kubelet/pods/944e6a1b-c0ff-48a6-8695-6348d6992ef7/volumes" Jul 09 22:37:32.770811 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:32.770718 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" event={"ID":"a099618b-0f06-41c5-8121-27d5d63325d6","Type":"ContainerStarted","Data":"e7df532001a7238fc40bc003bd34215ab47c5a4de8b6634947e38ebd563b39ac"} Jul 09 22:37:37.795930 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:37.795892 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" event={"ID":"a099618b-0f06-41c5-8121-27d5d63325d6","Type":"ContainerStarted","Data":"1d48c2436df9421a5d76f51d6ed29121cf07e1cc5a78839e71b34aaeeaec29f4"} Jul 09 22:37:37.796367 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:37.796029 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:37.817723 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:37.817669 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" podStartSLOduration=1.9641426640000001 podStartE2EDuration="6.817653294s" totalImagesPullingTime="4.85351063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:37.816747636 +0000 UTC m=+583.715530464" watchObservedRunningTime="2026-07-09 22:37:37.817653294 +0000 UTC m=+583.716436122" Jul 09 22:37:43.088206 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:43.088171 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:43.829770 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:43.829737 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-mkzv2" Jul 09 22:37:44.144751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:44.144714 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:44.440323 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:44.440246 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:50.547758 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.547727 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:50.561664 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.561635 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-76d66fc464-qf5gn"] Jul 09 22:37:50.564751 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.564730 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.567301 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.567281 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 22:37:50.567469 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.567326 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 22:37:50.567469 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.567428 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-phk98\"" Jul 09 22:37:50.577308 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.577279 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d66fc464-qf5gn"] Jul 09 22:37:50.702175 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.702107 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jn2x8\" (UniqueName: \"kubernetes.io/projected/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-kube-api-access-jn2x8\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.702354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.702204 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.702354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.702249 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-service-ca\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.750700 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.750666 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-b88d5"] Jul 09 22:37:50.754003 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.753981 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:50.764364 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.764336 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-b88d5"] Jul 09 22:37:50.802949 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.802853 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-service-ca\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.802949 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.802931 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jn2x8\" (UniqueName: \"kubernetes.io/projected/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-kube-api-access-jn2x8\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.803231 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.802980 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.803231 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:37:50.803089 2552 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 09 22:37:50.803231 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:37:50.803171 2552 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert podName:7a6d502c-9eaf-41fe-870e-0eefb3c8a476 nodeName:}" failed. No retries permitted until 2026-07-09 22:37:51.30313496 +0000 UTC m=+597.201917771 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert") pod "maas-controller-76d66fc464-qf5gn" (UID: "7a6d502c-9eaf-41fe-870e-0eefb3c8a476") : secret "maas-controller-webhook-cert" not found Jul 09 22:37:50.803538 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.803517 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-service-ca\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.813634 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.813611 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jn2x8\" (UniqueName: \"kubernetes.io/projected/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-kube-api-access-jn2x8\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:50.903912 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.903878 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-service-ca\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:50.904127 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.903939 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7cgv\" (UniqueName: \"kubernetes.io/projected/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-kube-api-access-x7cgv\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:50.904533 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:50.904026 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-webhook-cert\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.005985 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.005932 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7cgv\" (UniqueName: \"kubernetes.io/projected/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-kube-api-access-x7cgv\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.006229 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.006017 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-webhook-cert\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.006229 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.006097 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-service-ca\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.006780 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.006754 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-service-ca\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.008617 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.008593 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-webhook-cert\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.014421 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.014395 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7cgv\" (UniqueName: \"kubernetes.io/projected/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-kube-api-access-x7cgv\") pod \"maas-controller-6bf97d7bc6-b88d5\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.064827 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.064729 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:51.195649 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.195626 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-b88d5"] Jul 09 22:37:51.198011 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:37:51.197981 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea14e1f_15c2_4476_b2bb_e40f07f40e31.slice/crio-287a8c799b47fe5e22a2da380f7d6888197be79a0d15161666b6bc5b62e8b2d1 WatchSource:0}: Error finding container 287a8c799b47fe5e22a2da380f7d6888197be79a0d15161666b6bc5b62e8b2d1: Status 404 returned error can't find the container with id 287a8c799b47fe5e22a2da380f7d6888197be79a0d15161666b6bc5b62e8b2d1 Jul 09 22:37:51.308705 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.308671 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:51.311149 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.311127 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert\") pod \"maas-controller-76d66fc464-qf5gn\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:51.474687 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.474633 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:51.609230 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.609200 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-76d66fc464-qf5gn"] Jul 09 22:37:51.612183 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:37:51.612141 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a6d502c_9eaf_41fe_870e_0eefb3c8a476.slice/crio-506b2aa3727e075bca73792dde1f0eec681e60a2bef549b82df30309e59ccc03 WatchSource:0}: Error finding container 506b2aa3727e075bca73792dde1f0eec681e60a2bef549b82df30309e59ccc03: Status 404 returned error can't find the container with id 506b2aa3727e075bca73792dde1f0eec681e60a2bef549b82df30309e59ccc03 Jul 09 22:37:51.810888 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.810768 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:51.865739 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.865700 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" event={"ID":"7ea14e1f-15c2-4476-b2bb-e40f07f40e31","Type":"ContainerStarted","Data":"287a8c799b47fe5e22a2da380f7d6888197be79a0d15161666b6bc5b62e8b2d1"} Jul 09 22:37:51.867056 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:51.867025 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d66fc464-qf5gn" event={"ID":"7a6d502c-9eaf-41fe-870e-0eefb3c8a476","Type":"ContainerStarted","Data":"506b2aa3727e075bca73792dde1f0eec681e60a2bef549b82df30309e59ccc03"} Jul 09 22:37:53.676246 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.676214 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:53.768124 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.768030 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:37:53.878779 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.878743 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" event={"ID":"7ea14e1f-15c2-4476-b2bb-e40f07f40e31","Type":"ContainerStarted","Data":"74a3d1cfa6200d11cac3589b0ff6de6dda133d5c5ce490e47368c5200c56c93f"} Jul 09 22:37:53.878972 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.878804 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:37:53.880124 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.880100 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d66fc464-qf5gn" event={"ID":"7a6d502c-9eaf-41fe-870e-0eefb3c8a476","Type":"ContainerStarted","Data":"773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd"} Jul 09 22:37:53.880240 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.880212 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:37:53.897011 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.896968 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" podStartSLOduration=1.660769829 podStartE2EDuration="3.896951946s" totalImagesPullingTime="2.236182117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:53.895431554 +0000 UTC m=+599.794214382" watchObservedRunningTime="2026-07-09 22:37:53.896951946 +0000 UTC m=+599.795734773" Jul 09 22:37:53.914459 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:53.914408 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-76d66fc464-qf5gn" podStartSLOduration=2.082682461 podStartE2EDuration="3.914392773s" totalImagesPullingTime="1.831710312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:37:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:37:53.913240704 +0000 UTC m=+599.812023717" watchObservedRunningTime="2026-07-09 22:37:53.914392773 +0000 UTC m=+599.813175618" Jul 09 22:37:55.552474 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:37:55.552437 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:04.889835 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:04.889807 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:38:04.892572 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:04.890013 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:38:04.951200 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:04.951154 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d66fc464-qf5gn"] Jul 09 22:38:04.951419 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:04.951388 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-76d66fc464-qf5gn" podUID="7a6d502c-9eaf-41fe-870e-0eefb3c8a476" containerName="manager" containerID="cri-o://773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd" gracePeriod=30 Jul 09 22:38:05.199878 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.199848 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:38:05.219529 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.219497 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert\") pod \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " Jul 09 22:38:05.219722 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.219600 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-service-ca\") pod \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " Jul 09 22:38:05.219722 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.219644 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jn2x8\" (UniqueName: \"kubernetes.io/projected/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-kube-api-access-jn2x8\") pod \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\" (UID: \"7a6d502c-9eaf-41fe-870e-0eefb3c8a476\") " Jul 09 22:38:05.220108 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.220066 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-service-ca" (OuterVolumeSpecName: "service-ca") pod "7a6d502c-9eaf-41fe-870e-0eefb3c8a476" (UID: "7a6d502c-9eaf-41fe-870e-0eefb3c8a476"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:38:05.222057 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.222029 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7a6d502c-9eaf-41fe-870e-0eefb3c8a476" (UID: "7a6d502c-9eaf-41fe-870e-0eefb3c8a476"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:38:05.222332 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.222279 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-kube-api-access-jn2x8" (OuterVolumeSpecName: "kube-api-access-jn2x8") pod "7a6d502c-9eaf-41fe-870e-0eefb3c8a476" (UID: "7a6d502c-9eaf-41fe-870e-0eefb3c8a476"). InnerVolumeSpecName "kube-api-access-jn2x8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:38:05.321123 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.321082 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-service-ca\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:38:05.321123 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.321110 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jn2x8\" (UniqueName: \"kubernetes.io/projected/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-kube-api-access-jn2x8\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:38:05.321123 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.321121 2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7a6d502c-9eaf-41fe-870e-0eefb3c8a476-webhook-cert\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:38:05.930041 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.930003 2552 generic.go:356] "Generic (PLEG): container finished" podID="7a6d502c-9eaf-41fe-870e-0eefb3c8a476" containerID="773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd" exitCode=0 Jul 09 22:38:05.930555 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.930056 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-76d66fc464-qf5gn" Jul 09 22:38:05.930555 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.930095 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d66fc464-qf5gn" event={"ID":"7a6d502c-9eaf-41fe-870e-0eefb3c8a476","Type":"ContainerDied","Data":"773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd"} Jul 09 22:38:05.930555 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.930142 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-76d66fc464-qf5gn" event={"ID":"7a6d502c-9eaf-41fe-870e-0eefb3c8a476","Type":"ContainerDied","Data":"506b2aa3727e075bca73792dde1f0eec681e60a2bef549b82df30309e59ccc03"} Jul 09 22:38:05.930555 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.930187 2552 scope.go:117] "RemoveContainer" containerID="773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd" Jul 09 22:38:05.939136 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.939118 2552 scope.go:117] "RemoveContainer" containerID="773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd" Jul 09 22:38:05.939441 ip-10-0-139-240 kubenswrapper[2552]: E0709 22:38:05.939423 2552 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd\": container with ID starting with 773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd not found: ID does not exist" containerID="773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd" Jul 09 22:38:05.939503 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.939450 2552 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd"} err="failed to get container status \"773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd\": rpc error: code = NotFound desc = could not find container \"773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd\": container with ID starting with 773d9460d1a02bbfa91887cdda0aa0b20dc7c88ec14bcdc1996e23c9d1f2fefd not found: ID does not exist" Jul 09 22:38:05.951151 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.951125 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-76d66fc464-qf5gn"] Jul 09 22:38:05.954976 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:05.954955 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-76d66fc464-qf5gn"] Jul 09 22:38:06.542657 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:06.542626 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a6d502c-9eaf-41fe-870e-0eefb3c8a476" path="/var/lib/kubelet/pods/7a6d502c-9eaf-41fe-870e-0eefb3c8a476/volumes" Jul 09 22:38:22.723468 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:22.723388 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:28.850009 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:28.849977 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:29.263587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.263550 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:29.317588 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.317553 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-db47c776-clcgg"] Jul 09 22:38:29.317860 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.317848 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a6d502c-9eaf-41fe-870e-0eefb3c8a476" containerName="manager" Jul 09 22:38:29.317911 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.317861 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a6d502c-9eaf-41fe-870e-0eefb3c8a476" containerName="manager" Jul 09 22:38:29.317960 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.317923 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a6d502c-9eaf-41fe-870e-0eefb3c8a476" containerName="manager" Jul 09 22:38:29.323259 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.323241 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.325621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.325598 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mpfsd\"" Jul 09 22:38:29.325729 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.325622 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 09 22:38:29.333613 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.333592 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-db47c776-clcgg"] Jul 09 22:38:29.424078 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.424044 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k66vr\" (UniqueName: \"kubernetes.io/projected/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-kube-api-access-k66vr\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.424303 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.424094 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-openshift-service-ca\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.424303 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.424151 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-maas-api-tls\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.489743 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.489711 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:29.525401 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.525324 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k66vr\" (UniqueName: \"kubernetes.io/projected/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-kube-api-access-k66vr\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.525401 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.525381 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-openshift-service-ca\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.525559 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.525403 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-maas-api-tls\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.526071 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.526047 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-openshift-service-ca\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.527691 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.527670 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-maas-api-tls\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.533551 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.533529 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k66vr\" (UniqueName: \"kubernetes.io/projected/64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2-kube-api-access-k66vr\") pod \"maas-api-db47c776-clcgg\" (UID: \"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2\") " pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.634197 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.634172 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:29.770667 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.770642 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-db47c776-clcgg"] Jul 09 22:38:29.772713 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:38:29.772682 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64c2e0a6_4a8c_405e_82f5_392c8c5c0fb2.slice/crio-4b07cfd5a8317eee31ab2a5bf98956a3a1f5ecbd3f769d1e56b60d8f80eca44d WatchSource:0}: Error finding container 4b07cfd5a8317eee31ab2a5bf98956a3a1f5ecbd3f769d1e56b60d8f80eca44d: Status 404 returned error can't find the container with id 4b07cfd5a8317eee31ab2a5bf98956a3a1f5ecbd3f769d1e56b60d8f80eca44d Jul 09 22:38:29.877602 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:29.877566 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:30.005320 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.005284 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:30.037596 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.037521 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" event={"ID":"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2","Type":"ContainerStarted","Data":"4b07cfd5a8317eee31ab2a5bf98956a3a1f5ecbd3f769d1e56b60d8f80eca44d"} Jul 09 22:38:30.061115 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.061084 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8zxc9"] Jul 09 22:38:30.066335 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.066320 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.069680 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.069663 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 09 22:38:30.071338 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.071324 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-67nfg\"" Jul 09 22:38:30.084422 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.084399 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8zxc9"] Jul 09 22:38:30.129041 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.129019 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jzhc\" (UniqueName: \"kubernetes.io/projected/a78c86e8-7e79-4848-ab56-36c766729cfa-kube-api-access-2jzhc\") pod \"payload-pre-processing-7964457696-8zxc9\" (UID: \"a78c86e8-7e79-4848-ab56-36c766729cfa\") " pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.129151 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.129051 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78c86e8-7e79-4848-ab56-36c766729cfa-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8zxc9\" (UID: \"a78c86e8-7e79-4848-ab56-36c766729cfa\") " pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.171049 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.171018 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-nln29"] Jul 09 22:38:30.174737 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.174718 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.190198 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.190174 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-nln29"] Jul 09 22:38:30.230367 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.230341 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jzhc\" (UniqueName: \"kubernetes.io/projected/a78c86e8-7e79-4848-ab56-36c766729cfa-kube-api-access-2jzhc\") pod \"payload-pre-processing-7964457696-8zxc9\" (UID: \"a78c86e8-7e79-4848-ab56-36c766729cfa\") " pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.230528 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.230376 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78c86e8-7e79-4848-ab56-36c766729cfa-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8zxc9\" (UID: \"a78c86e8-7e79-4848-ab56-36c766729cfa\") " pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.230528 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.230404 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wq5v\" (UniqueName: \"kubernetes.io/projected/1a93d766-344c-43b1-bc80-8651863aff8b-kube-api-access-2wq5v\") pod \"payload-processing-58f86c7798-nln29\" (UID: \"1a93d766-344c-43b1-bc80-8651863aff8b\") " pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.230528 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.230439 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a93d766-344c-43b1-bc80-8651863aff8b-plugins-config-volume\") pod \"payload-processing-58f86c7798-nln29\" (UID: \"1a93d766-344c-43b1-bc80-8651863aff8b\") " pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.231083 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.231059 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a78c86e8-7e79-4848-ab56-36c766729cfa-plugins-config-volume\") pod \"payload-pre-processing-7964457696-8zxc9\" (UID: \"a78c86e8-7e79-4848-ab56-36c766729cfa\") " pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.238743 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.238717 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jzhc\" (UniqueName: \"kubernetes.io/projected/a78c86e8-7e79-4848-ab56-36c766729cfa-kube-api-access-2jzhc\") pod \"payload-pre-processing-7964457696-8zxc9\" (UID: \"a78c86e8-7e79-4848-ab56-36c766729cfa\") " pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.336901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.336819 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wq5v\" (UniqueName: \"kubernetes.io/projected/1a93d766-344c-43b1-bc80-8651863aff8b-kube-api-access-2wq5v\") pod \"payload-processing-58f86c7798-nln29\" (UID: \"1a93d766-344c-43b1-bc80-8651863aff8b\") " pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.336901 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.336881 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a93d766-344c-43b1-bc80-8651863aff8b-plugins-config-volume\") pod \"payload-processing-58f86c7798-nln29\" (UID: \"1a93d766-344c-43b1-bc80-8651863aff8b\") " pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.337809 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.337787 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a93d766-344c-43b1-bc80-8651863aff8b-plugins-config-volume\") pod \"payload-processing-58f86c7798-nln29\" (UID: \"1a93d766-344c-43b1-bc80-8651863aff8b\") " pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.345463 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.345435 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wq5v\" (UniqueName: \"kubernetes.io/projected/1a93d766-344c-43b1-bc80-8651863aff8b-kube-api-access-2wq5v\") pod \"payload-processing-58f86c7798-nln29\" (UID: \"1a93d766-344c-43b1-bc80-8651863aff8b\") " pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.376418 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.376399 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:30.484628 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.484595 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:30.506774 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.506747 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-8zxc9"] Jul 09 22:38:30.508853 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:38:30.508818 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda78c86e8_7e79_4848_ab56_36c766729cfa.slice/crio-b85f64909c0856ddef3bee719714eed0ded885b0127b0af888f7b40180417b69 WatchSource:0}: Error finding container b85f64909c0856ddef3bee719714eed0ded885b0127b0af888f7b40180417b69: Status 404 returned error can't find the container with id b85f64909c0856ddef3bee719714eed0ded885b0127b0af888f7b40180417b69 Jul 09 22:38:30.633119 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:30.633097 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-nln29"] Jul 09 22:38:30.635673 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:38:30.635645 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a93d766_344c_43b1_bc80_8651863aff8b.slice/crio-8675db618823b06b8af80bd88e81096b45497b6f1274b413dbb9f0e0a08ac398 WatchSource:0}: Error finding container 8675db618823b06b8af80bd88e81096b45497b6f1274b413dbb9f0e0a08ac398: Status 404 returned error can't find the container with id 8675db618823b06b8af80bd88e81096b45497b6f1274b413dbb9f0e0a08ac398 Jul 09 22:38:31.044708 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:31.044628 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-nln29" event={"ID":"1a93d766-344c-43b1-bc80-8651863aff8b","Type":"ContainerStarted","Data":"8675db618823b06b8af80bd88e81096b45497b6f1274b413dbb9f0e0a08ac398"} Jul 09 22:38:31.045829 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:31.045803 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" event={"ID":"a78c86e8-7e79-4848-ab56-36c766729cfa","Type":"ContainerStarted","Data":"b85f64909c0856ddef3bee719714eed0ded885b0127b0af888f7b40180417b69"} Jul 09 22:38:32.052854 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:32.052818 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" event={"ID":"64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2","Type":"ContainerStarted","Data":"1abcb51318094803cf0ca7974465495970108712ebcd5bc40c14146b62467360"} Jul 09 22:38:32.053306 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:32.053011 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:32.072576 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:32.072514 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" podStartSLOduration=1.435935466 podStartE2EDuration="3.072494216s" totalImagesPullingTime="1.63655875s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:38:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:38:32.069797984 +0000 UTC m=+637.968580813" watchObservedRunningTime="2026-07-09 22:38:32.072494216 +0000 UTC m=+637.971277045" Jul 09 22:38:33.060218 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:33.060180 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-nln29" event={"ID":"1a93d766-344c-43b1-bc80-8651863aff8b","Type":"ContainerStarted","Data":"d86a75e57fb4d1e6df0ee6626a615742fdc68af7413a279a74a4d7f1403eeff3"} Jul 09 22:38:33.060700 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:33.060277 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:33.061795 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:33.061769 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" event={"ID":"a78c86e8-7e79-4848-ab56-36c766729cfa","Type":"ContainerStarted","Data":"b23975af51a8bb823d7430ac34ad6962d8c79110bd582662841a7039c6401399"} Jul 09 22:38:33.078075 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:33.078034 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-nln29" podStartSLOduration=1.420743173 podStartE2EDuration="3.078021137s" totalImagesPullingTime="1.657277964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:38:33.075708995 +0000 UTC m=+638.974491976" watchObservedRunningTime="2026-07-09 22:38:33.078021137 +0000 UTC m=+638.976803943" Jul 09 22:38:33.091444 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:33.091404 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" podStartSLOduration=1.304384239 podStartE2EDuration="3.091390452s" totalImagesPullingTime="1.787006213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:38:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:38:33.08987146 +0000 UTC m=+638.988654289" watchObservedRunningTime="2026-07-09 22:38:33.091390452 +0000 UTC m=+638.990173280" Jul 09 22:38:34.067408 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:34.067372 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:38.068102 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:38.068069 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-db47c776-clcgg" Jul 09 22:38:39.018388 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:39.018351 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:39.114253 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:39.114212 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:43.621351 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.621321 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr"] Jul 09 22:38:43.626303 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.626270 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.628657 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.628633 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 22:38:43.628790 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.628690 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 09 22:38:43.629561 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.629539 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 22:38:43.629680 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.629654 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vhpzk\"" Jul 09 22:38:43.637846 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.637819 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr"] Jul 09 22:38:43.650845 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.650812 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:43.751809 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.751770 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e568b004-7f91-44d4-9178-d4d277175e8d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.751963 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.751849 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.751963 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.751873 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.751963 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.751913 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.751963 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.751956 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.752119 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.751990 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jmdg\" (UniqueName: \"kubernetes.io/projected/e568b004-7f91-44d4-9178-d4d277175e8d-kube-api-access-2jmdg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.852990 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.852951 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.852990 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853004 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853265 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853129 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jmdg\" (UniqueName: \"kubernetes.io/projected/e568b004-7f91-44d4-9178-d4d277175e8d-kube-api-access-2jmdg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853265 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853234 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e568b004-7f91-44d4-9178-d4d277175e8d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853375 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853295 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853375 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853318 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853479 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853456 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853637 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853614 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.853802 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.853736 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.855235 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.855216 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e568b004-7f91-44d4-9178-d4d277175e8d-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.855723 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.855701 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e568b004-7f91-44d4-9178-d4d277175e8d-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.861752 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.861729 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jmdg\" (UniqueName: \"kubernetes.io/projected/e568b004-7f91-44d4-9178-d4d277175e8d-kube-api-access-2jmdg\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr\" (UID: \"e568b004-7f91-44d4-9178-d4d277175e8d\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:43.937592 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:43.937566 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:44.069991 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:44.069958 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-nln29" Jul 09 22:38:44.071998 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:44.071969 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr"] Jul 09 22:38:44.075210 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:38:44.075174 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode568b004_7f91_44d4_9178_d4d277175e8d.slice/crio-d8e0e54ee3e3b1e9e2ac39f4abe4879f64bf13fac442aa16d88eb7cb99afd429 WatchSource:0}: Error finding container d8e0e54ee3e3b1e9e2ac39f4abe4879f64bf13fac442aa16d88eb7cb99afd429: Status 404 returned error can't find the container with id d8e0e54ee3e3b1e9e2ac39f4abe4879f64bf13fac442aa16d88eb7cb99afd429 Jul 09 22:38:44.076695 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:44.076675 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:38:44.116103 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:44.116068 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" event={"ID":"e568b004-7f91-44d4-9178-d4d277175e8d","Type":"ContainerStarted","Data":"d8e0e54ee3e3b1e9e2ac39f4abe4879f64bf13fac442aa16d88eb7cb99afd429"} Jul 09 22:38:45.073082 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:45.073054 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-8zxc9" Jul 09 22:38:46.135346 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:46.135313 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" event={"ID":"e568b004-7f91-44d4-9178-d4d277175e8d","Type":"ContainerStarted","Data":"c47177aa05590ce7cdbe49457936118c967f7933fafb24468e2963902e2e0105"} Jul 09 22:38:46.151587 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:46.151501 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" podStartSLOduration=2.032500549 podStartE2EDuration="3.151485401s" totalImagesPullingTime="1.118984852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:38:46.150908534 +0000 UTC m=+652.049691359" watchObservedRunningTime="2026-07-09 22:38:46.151485401 +0000 UTC m=+652.050268230" Jul 09 22:38:46.531549 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:46.531440 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:38:53.937738 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:53.937698 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:53.938222 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:53.937813 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:53.950063 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:53.950038 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:38:54.180864 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:38:54.180838 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr" Jul 09 22:39:06.483426 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:06.483363 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:06.532481 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:06.532453 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:11.114945 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.114910 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5"] Jul 09 22:39:11.120903 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.120879 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.123293 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.123267 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 22:39:11.131448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.131423 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5"] Jul 09 22:39:11.137255 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.137146 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:11.169032 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.168992 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.169251 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.169047 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkrnd\" (UniqueName: \"kubernetes.io/projected/72c77fa4-f902-470c-9a3b-c24643ab5dfd-kube-api-access-dkrnd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.169251 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.169124 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.169251 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.169212 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.169419 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.169277 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.169419 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.169302 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c77fa4-f902-470c-9a3b-c24643ab5dfd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270279 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270233 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270453 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270289 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkrnd\" (UniqueName: \"kubernetes.io/projected/72c77fa4-f902-470c-9a3b-c24643ab5dfd-kube-api-access-dkrnd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270453 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270339 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270453 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270379 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270453 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270430 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270453 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270450 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c77fa4-f902-470c-9a3b-c24643ab5dfd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270675 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270649 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270797 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270776 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.270868 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.270784 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.272666 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.272644 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72c77fa4-f902-470c-9a3b-c24643ab5dfd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.272956 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.272933 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72c77fa4-f902-470c-9a3b-c24643ab5dfd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.278531 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.278502 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkrnd\" (UniqueName: \"kubernetes.io/projected/72c77fa4-f902-470c-9a3b-c24643ab5dfd-kube-api-access-dkrnd\") pod \"e2e-trlp-test-simulated-kserve-598466548d-86vn5\" (UID: \"72c77fa4-f902-470c-9a3b-c24643ab5dfd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.431844 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.431795 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:11.568808 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:11.568783 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5"] Jul 09 22:39:11.571486 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:39:11.571452 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c77fa4_f902_470c_9a3b_c24643ab5dfd.slice/crio-39994a2d3f8a7a37dac798b5582cdf1edab3bc4e3d315e1c2d1a52f735512754 WatchSource:0}: Error finding container 39994a2d3f8a7a37dac798b5582cdf1edab3bc4e3d315e1c2d1a52f735512754: Status 404 returned error can't find the container with id 39994a2d3f8a7a37dac798b5582cdf1edab3bc4e3d315e1c2d1a52f735512754 Jul 09 22:39:12.253242 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:12.253209 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" event={"ID":"72c77fa4-f902-470c-9a3b-c24643ab5dfd","Type":"ContainerStarted","Data":"48bffbfba48270047b55efc5e2f258c5fe94043bf0c8ce09f5fad0fd222e66c6"} Jul 09 22:39:12.253657 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:12.253265 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" event={"ID":"72c77fa4-f902-470c-9a3b-c24643ab5dfd","Type":"ContainerStarted","Data":"39994a2d3f8a7a37dac798b5582cdf1edab3bc4e3d315e1c2d1a52f735512754"} Jul 09 22:39:12.272422 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:12.272354 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" podStartSLOduration=1.071996495 podStartE2EDuration="1.272335793s" totalImagesPullingTime="200.339298ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:39:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:39:12.270694111 +0000 UTC m=+678.169476940" watchObservedRunningTime="2026-07-09 22:39:12.272335793 +0000 UTC m=+678.171118621" Jul 09 22:39:18.293434 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:18.293396 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:19.438145 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:19.438112 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:20.769260 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:20.769216 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:20.870494 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:20.870460 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:21.432596 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:21.432555 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:21.432777 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:21.432623 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:21.444771 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:21.444742 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:22.309297 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:22.309264 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-86vn5" Jul 09 22:39:29.514462 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.514425 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp"] Jul 09 22:39:29.518541 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.518516 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.520759 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.520738 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 09 22:39:29.527670 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.527648 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp"] Jul 09 22:39:29.542360 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.542333 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:29.631518 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.631476 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fdk7\" (UniqueName: \"kubernetes.io/projected/c1854864-e848-4d68-b9b8-2959ee61ff35-kube-api-access-7fdk7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.631518 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.631519 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1854864-e848-4d68-b9b8-2959ee61ff35-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.631728 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.631601 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.631728 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.631671 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.631728 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.631688 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.631728 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.631714 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.732568 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.732536 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.732766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.732602 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.732766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.732617 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.732766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.732642 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.732766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.732667 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fdk7\" (UniqueName: \"kubernetes.io/projected/c1854864-e848-4d68-b9b8-2959ee61ff35-kube-api-access-7fdk7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.732766 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.732684 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1854864-e848-4d68-b9b8-2959ee61ff35-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.733056 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.733018 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.733123 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.733077 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.733123 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.733037 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.734955 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.734933 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c1854864-e848-4d68-b9b8-2959ee61ff35-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.735116 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.735097 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c1854864-e848-4d68-b9b8-2959ee61ff35-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.740726 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.740703 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fdk7\" (UniqueName: \"kubernetes.io/projected/c1854864-e848-4d68-b9b8-2959ee61ff35-kube-api-access-7fdk7\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-7gcbp\" (UID: \"c1854864-e848-4d68-b9b8-2959ee61ff35\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.830885 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.830796 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:29.963260 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:29.963114 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp"] Jul 09 22:39:29.965441 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:39:29.965415 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1854864_e848_4d68_b9b8_2959ee61ff35.slice/crio-62ea0ea012dd118c978a4a8c26fb180f260212ac67dd36d6b8fd6afcb16f5ec5 WatchSource:0}: Error finding container 62ea0ea012dd118c978a4a8c26fb180f260212ac67dd36d6b8fd6afcb16f5ec5: Status 404 returned error can't find the container with id 62ea0ea012dd118c978a4a8c26fb180f260212ac67dd36d6b8fd6afcb16f5ec5 Jul 09 22:39:30.333619 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:30.333573 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" event={"ID":"c1854864-e848-4d68-b9b8-2959ee61ff35","Type":"ContainerStarted","Data":"9a3b06f3b9bde8fdb435523d113e4839b45c69ff6ee2f650c377ff664a2884b4"} Jul 09 22:39:30.333809 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:30.333632 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" event={"ID":"c1854864-e848-4d68-b9b8-2959ee61ff35","Type":"ContainerStarted","Data":"62ea0ea012dd118c978a4a8c26fb180f260212ac67dd36d6b8fd6afcb16f5ec5"} Jul 09 22:39:30.351268 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:30.351217 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" podStartSLOduration=1.169431168 podStartE2EDuration="1.351201847s" totalImagesPullingTime="181.770679ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:39:30.350536247 +0000 UTC m=+696.249319079" watchObservedRunningTime="2026-07-09 22:39:30.351201847 +0000 UTC m=+696.249984674" Jul 09 22:39:36.043144 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:36.043109 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:39:39.831804 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:39.831746 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:39.832284 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:39.831842 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:39.844648 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:39.844611 2552 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:39:40.390304 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:39:40.390272 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-7gcbp" Jul 09 22:40:40.659342 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:40:40.659308 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:40:40.761787 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:40:40.761752 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:40:41.905757 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:40:41.905724 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:40:42.099452 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:40:42.099418 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:43:52.257398 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.257357 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:43:52.316062 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.316032 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-b88d5"] Jul 09 22:43:52.316244 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.316218 2552 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" podUID="7ea14e1f-15c2-4476-b2bb-e40f07f40e31" containerName="manager" containerID="cri-o://74a3d1cfa6200d11cac3589b0ff6de6dda133d5c5ce490e47368c5200c56c93f" gracePeriod=30 Jul 09 22:43:52.488322 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.488293 2552 generic.go:356] "Generic (PLEG): container finished" podID="7ea14e1f-15c2-4476-b2bb-e40f07f40e31" containerID="74a3d1cfa6200d11cac3589b0ff6de6dda133d5c5ce490e47368c5200c56c93f" exitCode=0 Jul 09 22:43:52.488454 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.488361 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" event={"ID":"7ea14e1f-15c2-4476-b2bb-e40f07f40e31","Type":"ContainerDied","Data":"74a3d1cfa6200d11cac3589b0ff6de6dda133d5c5ce490e47368c5200c56c93f"} Jul 09 22:43:52.573109 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.573084 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:43:52.615303 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.615267 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-webhook-cert\") pod \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " Jul 09 22:43:52.615303 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.615309 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-service-ca\") pod \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " Jul 09 22:43:52.615556 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.615331 2552 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7cgv\" (UniqueName: \"kubernetes.io/projected/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-kube-api-access-x7cgv\") pod \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\" (UID: \"7ea14e1f-15c2-4476-b2bb-e40f07f40e31\") " Jul 09 22:43:52.615759 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.615714 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-service-ca" (OuterVolumeSpecName: "service-ca") pod "7ea14e1f-15c2-4476-b2bb-e40f07f40e31" (UID: "7ea14e1f-15c2-4476-b2bb-e40f07f40e31"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 22:43:52.617479 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.617445 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "7ea14e1f-15c2-4476-b2bb-e40f07f40e31" (UID: "7ea14e1f-15c2-4476-b2bb-e40f07f40e31"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 22:43:52.617937 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.617916 2552 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-kube-api-access-x7cgv" (OuterVolumeSpecName: "kube-api-access-x7cgv") pod "7ea14e1f-15c2-4476-b2bb-e40f07f40e31" (UID: "7ea14e1f-15c2-4476-b2bb-e40f07f40e31"). InnerVolumeSpecName "kube-api-access-x7cgv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 22:43:52.716785 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.716749 2552 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-webhook-cert\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:43:52.716785 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.716776 2552 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-service-ca\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:43:52.716785 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:52.716786 2552 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7cgv\" (UniqueName: \"kubernetes.io/projected/7ea14e1f-15c2-4476-b2bb-e40f07f40e31-kube-api-access-x7cgv\") on node \"ip-10-0-139-240.ec2.internal\" DevicePath \"\"" Jul 09 22:43:53.493894 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:53.493868 2552 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" Jul 09 22:43:53.494320 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:53.493872 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf97d7bc6-b88d5" event={"ID":"7ea14e1f-15c2-4476-b2bb-e40f07f40e31","Type":"ContainerDied","Data":"287a8c799b47fe5e22a2da380f7d6888197be79a0d15161666b6bc5b62e8b2d1"} Jul 09 22:43:53.494320 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:53.494001 2552 scope.go:117] "RemoveContainer" containerID="74a3d1cfa6200d11cac3589b0ff6de6dda133d5c5ce490e47368c5200c56c93f" Jul 09 22:43:53.531321 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:53.531287 2552 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-b88d5"] Jul 09 22:43:53.533149 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:53.533122 2552 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-b88d5"] Jul 09 22:43:54.199709 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.199658 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:43:54.312518 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.312478 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-f5bl2"] Jul 09 22:43:54.312959 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.312940 2552 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ea14e1f-15c2-4476-b2bb-e40f07f40e31" containerName="manager" Jul 09 22:43:54.313059 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.312961 2552 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ea14e1f-15c2-4476-b2bb-e40f07f40e31" containerName="manager" Jul 09 22:43:54.313113 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.313071 2552 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ea14e1f-15c2-4476-b2bb-e40f07f40e31" containerName="manager" Jul 09 22:43:54.317467 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.317444 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.321311 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.321288 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-phk98\"" Jul 09 22:43:54.322123 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.322107 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 22:43:54.322196 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.322122 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 22:43:54.328121 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.328090 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-f5bl2"] Jul 09 22:43:54.430137 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.430097 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-service-ca\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.430137 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.430143 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-webhook-cert\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.430411 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.430218 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krtcv\" (UniqueName: \"kubernetes.io/projected/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-kube-api-access-krtcv\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.531107 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.531082 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-service-ca\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.531519 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.531117 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-webhook-cert\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.531519 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.531146 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krtcv\" (UniqueName: \"kubernetes.io/projected/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-kube-api-access-krtcv\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.531784 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.531766 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-service-ca\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.533879 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.533861 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 09 22:43:54.539898 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.539878 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krtcv\" (UniqueName: \"kubernetes.io/projected/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-kube-api-access-krtcv\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.544175 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.544136 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e-webhook-cert\") pod \"maas-controller-6bf97d7bc6-f5bl2\" (UID: \"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e\") " pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.544272 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.544154 2552 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7ea14e1f-15c2-4476-b2bb-e40f07f40e31" path="/var/lib/kubelet/pods/7ea14e1f-15c2-4476-b2bb-e40f07f40e31/volumes" Jul 09 22:43:54.630936 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.630903 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-phk98\"" Jul 09 22:43:54.638914 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.638889 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:54.776532 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.776509 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6bf97d7bc6-f5bl2"] Jul 09 22:43:54.778848 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:43:54.778816 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12aa52f5_1751_4c9d_8bac_cfe55a4e5b6e.slice/crio-648881416b96121b6e66084ae30b02bb6a85aed1d8d91b96123f59161140aaf2 WatchSource:0}: Error finding container 648881416b96121b6e66084ae30b02bb6a85aed1d8d91b96123f59161140aaf2: Status 404 returned error can't find the container with id 648881416b96121b6e66084ae30b02bb6a85aed1d8d91b96123f59161140aaf2 Jul 09 22:43:54.780261 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:54.780247 2552 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 22:43:55.286983 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:55.286960 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 09 22:43:55.505028 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:55.504994 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" event={"ID":"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e","Type":"ContainerStarted","Data":"ed826f87b1edf203d83f0a20ac36a64ffe972c6069a73e7e13ee228591149b28"} Jul 09 22:43:55.505229 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:55.505044 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" event={"ID":"12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e","Type":"ContainerStarted","Data":"648881416b96121b6e66084ae30b02bb6a85aed1d8d91b96123f59161140aaf2"} Jul 09 22:43:55.505229 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:55.505093 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:43:55.523013 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:43:55.522959 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" podStartSLOduration=1.018936577 podStartE2EDuration="1.522943243s" totalImagesPullingTime="504.006666ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 22:43:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:43:55.521252217 +0000 UTC m=+961.420035048" watchObservedRunningTime="2026-07-09 22:43:55.522943243 +0000 UTC m=+961.421726115" Jul 09 22:44:06.516140 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:44:06.516097 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6bf97d7bc6-f5bl2" Jul 09 22:44:22.310771 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:44:22.310684 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:45:36.457976 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:45:36.457933 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:41.795405 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:41.795371 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:41.900489 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:41.900449 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:42.036360 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:42.036328 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:47.864940 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:47.864907 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:47.967105 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:47.967071 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:48.067294 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:48.067259 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:48.237308 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:48.237265 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:54.176967 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:54.176935 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:46:54.276621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:46:54.276592 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:47:39.890569 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:47:39.890529 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:47:54.451192 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:47:54.451136 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:50:25.463641 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:50:25.463568 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:51:56.324622 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:51:56.324539 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:52:28.795248 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:28.795200 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9fflx_0d1d28b8-d682-471a-b6ae-d30b251d534f/manager/0.log" Jul 09 22:52:28.919605 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:28.919564 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bf97d7bc6-f5bl2_12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e/manager/0.log" Jul 09 22:52:29.050413 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:29.050339 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r2rg8_1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80/server/0.log" Jul 09 22:52:29.414627 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:29.414598 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-5cd6f_4935f051-3669-406c-a548-9889b76b1b50/manager/0.log" Jul 09 22:52:29.421519 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:29.421500 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-5cd6f_4935f051-3669-406c-a548-9889b76b1b50/copy-manifests/0.log" Jul 09 22:52:29.875663 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:29.875585 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-db47c776-clcgg_64c2e0a6-4a8c-405e-82f5-392c8c5c0fb2/maas-api/0.log" Jul 09 22:52:29.983884 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:29.983851 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-mkzv2_a099618b-0f06-41c5-8121-27d5d63325d6/postgres/0.log" Jul 09 22:52:31.389723 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:31.389695 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vkhsc_3afc2cf3-4e1e-4be9-8390-92edfa84dd64/manager/0.log" Jul 09 22:52:31.505357 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:31.505329 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cmkst_caa57e68-7574-4527-900e-dfbd2c2ee65e/manager/0.log" Jul 09 22:52:32.560272 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:32.560239 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-km8fd_e9754815-6caf-4abb-96db-88f833fe632b/discovery/0.log" Jul 09 22:52:32.673791 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:32.673752 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686787b779-2jl6h_d1932766-3c84-4573-be38-b491079b0f84/kube-auth-proxy/0.log" Jul 09 22:52:33.013376 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:33.013345 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8zxc9_a78c86e8-7e79-4848-ab56-36c766729cfa/payload-pre-processing/0.log" Jul 09 22:52:33.125972 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:33.125940 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nln29_1a93d766-344c-43b1-bc80-8651863aff8b/payload-processing/0.log" Jul 09 22:52:33.579041 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:33.579012 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-ppfzr_e568b004-7f91-44d4-9178-d4d277175e8d/main/0.log" Jul 09 22:52:33.812495 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:33.812468 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-86vn5_72c77fa4-f902-470c-9a3b-c24643ab5dfd/main/0.log" Jul 09 22:52:34.034271 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:34.034244 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-7gcbp_c1854864-e848-4d68-b9b8-2959ee61ff35/main/0.log" Jul 09 22:52:38.591589 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:38.591546 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:52:38.692347 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:38.692316 2552 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" limit=1024 Jul 09 22:52:40.466454 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:40.466429 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fnlb7_2327c414-5cc3-446b-8261-3c87acd3ea07/global-pull-secret-syncer/0.log" Jul 09 22:52:40.555341 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:40.555312 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-bwzsp_474dae2e-6f22-4fed-b9a3-38924f38e576/konnectivity-agent/0.log" Jul 09 22:52:40.686986 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:40.686962 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-240.ec2.internal_40e1f116d5815810e312bf19af51fd4f/haproxy/0.log" Jul 09 22:52:46.029366 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:46.029334 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-vkhsc_3afc2cf3-4e1e-4be9-8390-92edfa84dd64/manager/0.log" Jul 09 22:52:46.064012 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:46.063987 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-cmkst_caa57e68-7574-4527-900e-dfbd2c2ee65e/manager/0.log" Jul 09 22:52:48.299965 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:48.299896 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zjrm_e363b123-5cb9-4d50-af5c-8a37b7dd5fbc/node-exporter/0.log" Jul 09 22:52:48.322829 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:48.322806 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zjrm_e363b123-5cb9-4d50-af5c-8a37b7dd5fbc/kube-rbac-proxy/0.log" Jul 09 22:52:48.342822 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:48.342799 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8zjrm_e363b123-5cb9-4d50-af5c-8a37b7dd5fbc/init-textfile/0.log" Jul 09 22:52:50.753899 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.753861 2552 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv"] Jul 09 22:52:50.757369 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.757347 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.759771 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.759739 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5jvk\"/\"openshift-service-ca.crt\"" Jul 09 22:52:50.759952 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.759924 2552 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-s5jvk\"/\"default-dockercfg-tdkvb\"" Jul 09 22:52:50.760878 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.760863 2552 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-s5jvk\"/\"kube-root-ca.crt\"" Jul 09 22:52:50.765203 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.765176 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv"] Jul 09 22:52:50.839621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.839586 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-lib-modules\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.839621 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.839633 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-proc\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.839836 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.839650 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-podres\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.839836 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.839724 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-sys\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.839836 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.839762 2552 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q4l7\" (UniqueName: \"kubernetes.io/projected/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-kube-api-access-6q4l7\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940256 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940222 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-sys\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940267 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q4l7\" (UniqueName: \"kubernetes.io/projected/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-kube-api-access-6q4l7\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940317 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-lib-modules\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940332 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-sys\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940353 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-proc\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940379 2552 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-podres\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940416 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-proc\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940671 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940470 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-lib-modules\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.940671 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.940521 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-podres\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:50.948584 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:50.948561 2552 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q4l7\" (UniqueName: \"kubernetes.io/projected/19e5a5eb-a147-4e34-acc0-e8a6ad752aa5-kube-api-access-6q4l7\") pod \"perf-node-gather-daemonset-2t8bv\" (UID: \"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5\") " pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:51.068520 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.068438 2552 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:51.206008 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.205964 2552 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv"] Jul 09 22:52:51.209030 ip-10-0-139-240 kubenswrapper[2552]: W0709 22:52:51.209004 2552 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod19e5a5eb_a147_4e34_acc0_e8a6ad752aa5.slice/crio-acd4535c41645287a34f95c8744bdb80cae33a07d16b9e504ff1407c782cbf7c WatchSource:0}: Error finding container acd4535c41645287a34f95c8744bdb80cae33a07d16b9e504ff1407c782cbf7c: Status 404 returned error can't find the container with id acd4535c41645287a34f95c8744bdb80cae33a07d16b9e504ff1407c782cbf7c Jul 09 22:52:51.477082 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.477052 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-prtnq_d9852ef0-8138-4818-93fd-9da911a0787e/download-server/0.log" Jul 09 22:52:51.861319 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.861223 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" event={"ID":"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5","Type":"ContainerStarted","Data":"905e6bc44fe04b42b01fc670ef04f4ae0104b4c7848fba8f9a229955361e7b16"} Jul 09 22:52:51.861319 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.861284 2552 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" event={"ID":"19e5a5eb-a147-4e34-acc0-e8a6ad752aa5","Type":"ContainerStarted","Data":"acd4535c41645287a34f95c8744bdb80cae33a07d16b9e504ff1407c782cbf7c"} Jul 09 22:52:51.861728 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.861434 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:51.879263 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:51.879213 2552 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" podStartSLOduration=1.8791979090000002 podStartE2EDuration="1.879197909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 22:52:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 22:52:51.87841246 +0000 UTC m=+1497.777195289" watchObservedRunningTime="2026-07-09 22:52:51.879197909 +0000 UTC m=+1497.777980733" Jul 09 22:52:53.246496 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:53.246461 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v9r9f_e0986295-13f5-4f88-9029-b7a13917159c/dns/0.log" Jul 09 22:52:53.272368 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:53.272343 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-v9r9f_e0986295-13f5-4f88-9029-b7a13917159c/kube-rbac-proxy/0.log" Jul 09 22:52:53.300456 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:53.300432 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-82w6l_2693927f-4336-4752-8680-9328d861683a/dns-node-resolver/0.log" Jul 09 22:52:53.876386 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:53.876352 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-67975944b9-lmftf_bcfc98ac-0003-4e58-a1cc-e49aa7daa541/registry/0.log" Jul 09 22:52:53.898029 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:53.898003 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-56fpj_3a2d66cc-9134-4c96-bb3c-df4a05c605fb/node-ca/0.log" Jul 09 22:52:54.949228 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:54.949187 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-km8fd_e9754815-6caf-4abb-96db-88f833fe632b/discovery/0.log" Jul 09 22:52:54.967116 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:54.967087 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686787b779-2jl6h_d1932766-3c84-4573-be38-b491079b0f84/kube-auth-proxy/0.log" Jul 09 22:52:55.085551 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:55.085519 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8zxc9_a78c86e8-7e79-4848-ab56-36c766729cfa/payload-pre-processing/0.log" Jul 09 22:52:55.114362 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:55.114328 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nln29_1a93d766-344c-43b1-bc80-8651863aff8b/payload-processing/0.log" Jul 09 22:52:55.805487 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:55.805438 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cx995_400fbc3c-86a2-4987-adf6-ad2fcbf2f96d/serve-healthcheck-canary/0.log" Jul 09 22:52:56.452726 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:56.452698 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7qdq_34d1101b-5c0e-4e20-bc76-a5f839b8e9c1/kube-rbac-proxy/0.log" Jul 09 22:52:56.472202 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:56.472155 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7qdq_34d1101b-5c0e-4e20-bc76-a5f839b8e9c1/exporter/0.log" Jul 09 22:52:56.492737 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:56.492712 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-t7qdq_34d1101b-5c0e-4e20-bc76-a5f839b8e9c1/extractor/0.log" Jul 09 22:52:57.876354 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:57.876326 2552 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-s5jvk/perf-node-gather-daemonset-2t8bv" Jul 09 22:52:58.784849 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:58.784822 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-9fflx_0d1d28b8-d682-471a-b6ae-d30b251d534f/manager/0.log" Jul 09 22:52:58.824358 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:58.824331 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6bf97d7bc6-f5bl2_12aa52f5-1751-4c9d-8bac-cfe55a4e5b6e/manager/0.log" Jul 09 22:52:58.843003 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:58.842982 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-r2rg8_1e8b1f29-ea9f-4f09-b553-7c39f8ee8c80/server/0.log" Jul 09 22:52:59.002604 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:59.002577 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-5cd6f_4935f051-3669-406c-a548-9889b76b1b50/manager/0.log" Jul 09 22:52:59.026872 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:52:59.026841 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7ddf58f47c-5cd6f_4935f051-3669-406c-a548-9889b76b1b50/copy-manifests/0.log" Jul 09 22:53:01.456129 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:01.456054 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-km8fd_e9754815-6caf-4abb-96db-88f833fe632b/discovery/0.log" Jul 09 22:53:01.469879 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:01.469845 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686787b779-2jl6h_d1932766-3c84-4573-be38-b491079b0f84/kube-auth-proxy/0.log" Jul 09 22:53:01.553527 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:01.553496 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8zxc9_a78c86e8-7e79-4848-ab56-36c766729cfa/payload-pre-processing/0.log" Jul 09 22:53:01.570624 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:01.570595 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nln29_1a93d766-344c-43b1-bc80-8651863aff8b/payload-processing/0.log" Jul 09 22:53:02.829448 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:02.829411 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-km8fd_e9754815-6caf-4abb-96db-88f833fe632b/discovery/0.log" Jul 09 22:53:02.845905 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:02.845880 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-686787b779-2jl6h_d1932766-3c84-4573-be38-b491079b0f84/kube-auth-proxy/0.log" Jul 09 22:53:02.916591 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:02.916564 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-8zxc9_a78c86e8-7e79-4848-ab56-36c766729cfa/payload-pre-processing/0.log" Jul 09 22:53:02.933769 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:02.933742 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-nln29_1a93d766-344c-43b1-bc80-8651863aff8b/payload-processing/0.log" Jul 09 22:53:05.578591 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:05.578556 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-f7jjm_df1db871-8be2-4882-8438-9fab9e47423b/migrator/0.log" Jul 09 22:53:05.598426 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:05.598395 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-f7jjm_df1db871-8be2-4882-8438-9fab9e47423b/graceful-termination/0.log" Jul 09 22:53:06.936032 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:06.935990 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-25jwc_f783638e-fe2e-4fa8-8076-fe55328cc59e/kube-multus/0.log" Jul 09 22:53:07.101338 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.101307 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/kube-multus-additional-cni-plugins/0.log" Jul 09 22:53:07.123719 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.123694 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/egress-router-binary-copy/0.log" Jul 09 22:53:07.145444 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.145419 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/cni-plugins/0.log" Jul 09 22:53:07.166710 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.166684 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/bond-cni-plugin/0.log" Jul 09 22:53:07.187369 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.187292 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/routeoverride-cni/0.log" Jul 09 22:53:07.210410 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.210381 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/whereabouts-cni-bincopy/0.log" Jul 09 22:53:07.233555 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.233528 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cffd4_87bd8a1f-a844-4a10-bd8d-70a9852a7bd5/whereabouts-cni/0.log" Jul 09 22:53:07.486738 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.486652 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5d8hc_7540a706-475e-457e-a0c7-3fcc142e8ea6/network-metrics-daemon/0.log" Jul 09 22:53:07.511727 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:07.511701 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5d8hc_7540a706-475e-457e-a0c7-3fcc142e8ea6/kube-rbac-proxy/0.log" Jul 09 22:53:08.836613 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.836583 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/ovn-controller/0.log" Jul 09 22:53:08.854129 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.854103 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/ovn-acl-logging/0.log" Jul 09 22:53:08.875069 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.875044 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/kube-rbac-proxy-node/0.log" Jul 09 22:53:08.895816 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.895789 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 22:53:08.915310 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.915278 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/northd/0.log" Jul 09 22:53:08.935251 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.935224 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/nbdb/0.log" Jul 09 22:53:08.958401 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.958370 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/sbdb/0.log" Jul 09 22:53:08.995760 ip-10-0-139-240 kubenswrapper[2552]: I0709 22:53:08.995727 2552 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wpx72_2828a1b3-cc74-4852-be04-87dbc797f6b9/ovnkube-controller/0.log"